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(54) A NETWORK CONTROL SYSTEM 

(57) An object of the present invention is to provide 
a network control system capable of flexibly construct- 
ing an operational environment suitable tor each func- 
tion and equipment in a simple configuration with a fight 
load on a transmission line and each equipment and 
readily adapting to a new function not conceivable at 
present. To attain the above object, a network control 
system according to the present invention controls at 
least one piece of equipment from another piece of 
equipment through a transmission line in a system in 
which a plurality of equipment interconnected over the 

Fig. 1 
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transmission line. The network control system com- 
prises a controller having a user interface and a device 
having a function list (8) indicating functions thereof as 
constituents in any equipment connected to the trans- 
mission fine The device transmits the function list (8) 
through the transmission fine (1). The controller notifies 
information about the device to a user with using the 
received function fist (8). and controls the device with 
utilizing flie function fist (8) in accordance with a user s 
operation. 
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Description 
TECHNICAL FIELD 

[0001] The present invention relates to network con- s 
trol systems for operating over networks equipment 
interconnected on the networks, and more specifically 
to an equipment control system providing on a screen a 
graphical user interface (GUI) for supporting user's 
operation of equipment by means of graphics, charac- to 
ters and the like. 

BACKGROUND ART 

[0002] In recent years, an equipment control system is 
which displays on a TV screen graphics (icon) compris- 
ing of screen display data, characters and the tike for 
representing the functions of equipment and controls 
the equipment based on user's operation of selecting 
and manipulating the graphics with a TV remote control- 20 
ler has been introduced. Moreover, a networked system 
interconnecting digital equipment such as DVC (digital 
video cassette) therein using the IEEE standard 1394- 
1995 to transmit and receive video/audio data is also in 
use. 25 
[0003] One of conventional network control systems is 
disclosed in Japanese Patent Laying-Open No. 9- 
149325. 

[0004] An example of the conventional network control 
systems is described below. 30 
[0005] AV equipment is connected with another AV 
equipment on a serial bus, such as a digital interface, for 
example, the IEEE standard 1394 and the like, over 
which the AV equipment is provided with equal commu- 
nication opportunities at periodic time intervals in two- 35 
way packet communication mode without switching con- 
nection therebetween. 

[0006] Here, each AV equipment contains peculiar 
screen display data therein, to transmit the screen dis- 
play data to a controller (tor example, a television set) aq 
having the function of displaying graphics in response to 
a request from the controller. The controller then dis- 
plays the screen cfisplay data. 
[0007] Besides, the controller has also the functions of 
making inquiries about the data required for displaying 45 
the AV equipment connected thereto, and controlling 
display on a screen generated based on the screen dis- 
play data suppfied from the AV equipment. 
[0008] Each AV equipment has a storage medium 
storing the screen cfi splay data thereon, and the tunc- so 
ton of selecting appropriate screen cfisplay data in 
response to the inquiry about screen display data from 
the controller. 

[0009] In the network control system configured as 
above, the screen cfisplay data is saved in each device 55 
(AV equipment), and outputted in response to the dis- 
play request from the controller (television set). The 
graphics peculiar to each device (AV equipment) is thus 



displayed on the screen of the controller. * 
[0010] In the network control system with the above 
configuration, however, when the screen display data is 
required, for example, when the displayed graphics, for 
representing the device, such as an icon is changed by 
user's operation, the controller must inquire the screen 
display data about the device through a transmission 
fine This leads to a problem that the traffic on the trans- 
mission line increases and much time is spent for dis- 
playing the data. 

[0011] Moreover, the network control system has 
another problem that the device is required to have the 
function of selecting appropriate screen display data in 
response to the inquiry from the controller, which results 
in heavy processing load on the device. 
[0012] Furthermore, the network control system has a 
further problem that the screen display data is peculiar 
to each AV equipment and therefore has little flexibility 
in display on the controller. 

[0013] The present invention solves the above- 
described problems- That is, an object of the present 
invention is to provide a network control system capable 
of flexibly constructing an operational environment suit- 
able for each function and equipment in a simple config- 
uration with a light load on a transmission line and each 
equipment and readily adapting to even a new function 
not conceivable at present and further to equipment 
having a plurality of devices. 

DISCLOSURE OF THE INVENTION 

[0014] A first aspect of the present invention is 
directed to a network control system in which a plurality 
of equipment are connected through a transmission 
line, and first equipment controls second equipment 
through the transmission line, wherein 

at least one of the first and second equipment han- 
dles at least one of video, audio and information, 
the first equipment includes a controller having a 
user interface, 

the second equipment includes a device to be con- 
trolled by the controller. 

the device has function information indicating func- 
tions of the device itself, and 
the controller acquires the function information from 
the device through the transmission line, and con- 
trols the device through the transmission line 
through the use of the function information accord- 
ing to a user's operation performed by means of the 
user interface. 

[0015] According to the first aspect of the present 
invention, provided are a controller having a user inter- 
face, a device having function information indicating its 
own functions. The device transmits the function infor- 
mation to the controller through a transmission fine, and 
the controller notifies information about the device to a 
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user through the use of the function information and 
controls the device according to the user's operation, 
whereby a user-friendly operational environment can be 
realized in a simple configuration and it is possftrfe to 
readily adapt to a device having a new function not con- 5 
ceivable at present 

[001 6] A second aspect is directed to second equip- 
ment, connected to first equipment including a controller 
through a transmission line, including a device to be 
controlled by the controller through the transmission 10 
line. 

at least one of the first and second equipment han- 
dling at least one of video, audio and information, 
and /5 
wherein the device 

has function information indicating functions of the 
device, 

sends the function information to the transmission 
line in response to a request from the controller, so 
and 

operates in accordance with control performed by 
the controller on a basis of the function information 
to realize the functions of the device. 

25 

[001 7] The equipment according to the second aspect 
of the present invention can be used as second equip- 
ment including the device to be controlled in the network 
control system according to the first aspect of the 
present invention. & 
[0018] A third aspect of the present invention is 
directed to first equipment, connected to second equip- 
ment through a transmission line, including a controller 
controlling a device included in the second equipment 
through the transmission line, , 35 

at least one of the first and second equipment han- 
dling at least one of video, audio, and information, 
and 

wherein the controller 40 
comprises a user interface, 
acquires function information indicating functions of 
the device from the device through the transmission 
Dne. and 

controls the device through the transmission line <5 
through the use of the function information accord- 
ing to a user's operation performed by means of the 
user interface. 

[0019] The equipment according to the third aspect of so 
the present invention can be used as first equipment 
including the controller in the network control system 
according to the first aspect of the present invention. 
[0020J According to a fourth aspect of the present 
invention, in the first aspect of the present invention, 55 

the function information has a layer structure, and 
includes a device information layer composed of 



attribute information including . identification infor- 
mation of the device, and function information layer 
indicating the functions of the device. 

[0021 ] According to the fourth aspect of the present 
invention, a device information layer composed of 
attribute information including identification information 
of the device, and function information layer indicating 
the functions of the device are provided in the function 
information. Therefore, it is possible to optimize both an 
operational environment tor each device and an opera- 
tional environment for each function of the device, and 
realize a user-friendly operational environment. 
[0022] According to a fifth aspect of the present inven- 
tion, in the f irst aspect of the present invention, 

the device includes a plurality of sub-devices, and 
the function information has a layer structure, and 
includes a device information layer composed of 
attribute information including identification infor- 
mation of the device, a sub-device information layer 
composed of attribute information including identifi- 
cation ^formation of the sub-devices, and function 
information layer indicating the functions of the sub- 
device. 

[0023] According to the fifth aspect of the present 
invention, a device information layer indicating informa- 
tion about the device, a sub-device information layer 
indicating information about the subdevices in the 
device, and a function information layer indicating the 
functions of the sub-devices are provided. Conse- 
quently, appropriate operational environment can be 
provided for each sub-device in each device, and the 
device can be controlled from different controllers tor 
each sub-device. 

[0024] According to a sixth aspect of the present 
invention, in the first aspect of the present invention. 

the function information includes user interface 
information. 

[0025] According to a seventh aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention. 

the function information includes a device GUI layer 
composed of user interlace information of the 
device identified with the attribute information in the 
device information layer. 



According to an eighth aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention, 

the function information includes a function GUI 
layer composed of user interface information of the 
functions in the function information layer 
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[0027) According to a ninth aspect of the present 
invention, in the fifth aspect of the present invention, 

the function information has a sub-device GUI layer 
composed of user interface information of sub- £ 
devices identified with the attribute information in 
the sub-device information layer. 

[0028] According to the seventh, eighth, ninth aspects 
of the present invention, a device GUI layer, function w 
GUI layer, and sub-device GUI layer describing user 
interface information of the device indicated in a device 
information layer, a function information layer, and sub- ' 
device are included. This makes H possible to construct 
a flexible user interface for each hierarchy and realize 15 
an optimal operational environment for each device, 
function, and sub-device. 

[0029J According to a tenth aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention, an identifier is provided for each of the tunc- 20 
tions in the function information layer. 
[0030] According to the tenth aspect of the present 
invention, an identifier is provided for each function 
described in the function information layer, and thereby 
making identification and retrieval of the functions eas- 2$ 
ier when managing/consulting function information with 
the controller. 

[0031 ] According to an eleventh aspect of the present 
invention, in the seventh, eighth or ninth aspect of the 
present invention. 30 

information in the device GUI layer, the function 
GUI layer or the sub-device GUI layer is classified 
according to user's operation and a status of the 
device. 35 

[0032] According to the eleventh aspect, the device 
GUI layer, the function GUI layer or the sub-device GUI 
layer is classified accoroing to user's operation and a 
status of the device. Therefore, a user-friendly and 40 
easy-to-under stand operational environment can be 
readily constructed. 

[0033] According to a twelfth aspect of the present 
invention, in the first aspect of the present invention, 

45 

the function information includes a control code cor- 
responding to each of the functions which the 
device has. and 

when the controller transmits the control code 
included in the function information to the device so 
through the transmission line, the device operates 
in accordance with the control code to realize a 
function corresponding to the control code. 

[0034] Accoroing to the twelfth aspect of the present 55 
invention, the controfler does not necessarfly have to 
understand each function of a device to be controlled 
since the controller acquires from the device the func- 



tion information inctutfing a control code which can be 
interpreted and executed by the device. For example, as 
for a device having a new function not conceivable at 
present, the controller can make the device execute the 
new function by referring to the function information of 
the device and transmitting the control code to the 
device according to the user's operation performed by 
means of the user interface. Accordingly, the user can 
execute a new function not conceivable at present. 
[0035] According to a thirteenth aspect of the present 
invention, in the second aspect of the present invention. 

the function information includes a control code cor- 
responding to each of the functions of the device, 
and 

the device sends the function information to the 
transmission line in response to the predetermined 
request from the controller, and operates in accord- 
ance with the control code received from the con- 
troller, to realize a function corresponding to the 
control code. 

[0036] The equipment according to the thirteenth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the twelfth aspect 
of the present invention. 

[0037] According to a fourteenth aspect of the present 
invention, in the third aspect of the present invention, 

the controller acquires the function information 
including a control code corresponding to each of 
the functions of the device from the device through 
the transmission line, and sends the control code in 
the function information to the device through the 
transmission fine according to the user's operation 
performed by means of the user interface, to control 
the device. 

[0038] The equipment according to the fourteenth 
aspect of the present invention can be used as first . 
equipment including the controller in the network control 
system accorcfing to the twelfth aspect of the present 
invention. 

[0039] According to a fifteenth aspect of the present 
invention, in the first aspect of the present invention, 

the function information includes cfcpiay data rep- 
resenting each of the functions of the device, and 
the controfler includes Display means for displaying 
the functions of the device through the use of the 
olsplay data. 

[0040] According to the fifteenth aspect of the present 
invention, the function information has display data rep- 
resenting each function of the device, whereby optima) 
screen display can be presented for each function of the 
device and a user -friendly operational screen display 
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can be realized. 

[0041] According to a sixteenth aspect of the present 
invention, in the second aspect of the present invention, 

the function information includes display data rep* s 
resenting each of the functions of the device, and 
the device sends the function information to the 
transmission line in response to the predetermined 
request from the controller , and operates in accord- 
ance with the control performed by the controller on w 
the basis of the function information, to realize the 
functions of the device. 

[0042] The equipment according to the sixteenth 
aspect of the present invention can be used as second is 
equipment including the device to be controlled in the 
network control system according to the fifteenth aspect 
of the present invention. 

[0043] According to a seventeenth aspect of the 
present invention, in the third aspect of the present 20 
invention. 

the controller 

comprises display means as the user interface, and 
acquires the function information including display 25 
data representing each of the functions of the 
device from the device through the transmission 
line, and displays each of the functions of the 
device with the display means through the use of 
the display data, to control the device through the 30 
transmission fine through the use of the function 
information according to the user s operation per- 
formed by means of the user interface 

[0044] The equipment according to the seventeenth 35 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the fifteenth aspect of the present 
invention. 

[0045] According to an eighteenth aspect of the 40 
present invention, in the fifteenth aspect of the present 
invention. 

the function information includes a control code cor- 
responding to each of the display data, 45 
the controller displays each of the functions of the 
device with the display means through the use of 
the cfisptay data included in the function informa- 
tion, and transmits the control code corresponding 
to the display data through the transmission line to so 
the device according to the user's operation per- 
formed by means of the user interface for the cfis- 
ptay data, and 

the device operates in accordance with the control 
code received from the controller through the trans- 55 
mission fine, to realize a function indicated by the 
display data corresponding to the control code. 



[0046] According to the eighteenth aspect, the control- 
ler does not necessarily have to understand each func- 
tion of the device since the controller acquires from the 
device the function information including display data 
representing each function of the device and a control 
code corresponding to each of the display data. For 
example, as for a device having a new function not con- 
ceivable at present, the controller can fetch from the 
function information display data representing the new 
function and displays the same on the screen to notify 
the user. Then, when the user understands the new 
function from graphics and the like on the screen and 
selects the function, the controller refers to the function 
information, then obtains a control code corresponding 
to the new function, and transmits the control code to 
the device, to make the device execute the new func- 
tion. Accordingly, the user can execute even a new func- 
tion not conceivable at present. 
[0047] According to a nineteenth aspect of the present 
invention, in the sixteenth aspect of the present inven- 
tion. 

the function information includes a control code cor- 
responding to each of the display data, and 
the device sends the function information to the 
transmission line in response to the predetermined 
request from the controller, and operates in accord- 
ance with the control code received from the con- 
troller, to realize a function indicated by the display 
data conesponding to the control code. 

[0048] The equipment according to the nineteenth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the eighteenth 
aspect of the present invention. 
[0049] According to a twentieth aspect of the present 
invention, in the seventeenth aspect of the present 
invention, 

the controller acquires the function information 
including the display data representing each of the 
functions of the device and a control code cone- 
sponding to each of the display data, displays each 
of the functions of the device through the use of the 
cSsplay data with the display means, and transmits 
the control code corresponding to the display data 
through the transmission line according to the 
user's operation performed by means of the user 
interface for the cfisplay data, to control the device. 

[0050] The equipment according to the twentieth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the eighteenth aspect of the 
present invention. 

[0051] According to a twenty-first aspect of the 
present invention, in the eleventh aspect of the present 
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invention, . 

the device GUI layer, the function GUI layer, or the 
sub-device GUI layer includes display data for each 
of the classified categories, and s 
the controller comprises display means for display- 
ing the user interface of the device, the function, or 
the sub-device for each of the categories through 
the use of the display data. 

JO 

[0052] According to the twenty-first aspect of the 
present invention, the device GUI layer, function GUI 
layer or sub-device GUI layer has display data for each 
category, whereby optimal screen display can be pre- 
sented for each category. As a result, it is possible to is 
provide an operational screen which can deepen the 
user s intuitive understanding and support the user's 
operation. 

{0053} According to a twenty-second aspect of the 
present invention, in the first aspect of the present 20 
invention. 

the function information includes audio data tor the 
user interface, and 

the controller includes audio reproducing means for 25 
reproducing audio through the use of the audio 
data. 



the device comprises: 

device communication means for communicating 
with the controller through the transmission line; 
and 

first control means for sending the function informa- 
tion to the transmission fine in response to a prede- 
termined request received from the controller with 
the device communication means, and making the 
device operate in accordance with the control code 
received from the controller with the device commu- 
nication means, and 
the controller comprises: 

controller communication means for communicat- 
ing with the device through the transmission line; 
and 

second control means for acquiring the function 
information from the device by transmitting the pre- 
determined request to the device with the controller 
communication means, and for controlling the 
device by transmitting the control code in the func- 
tion information with the controller communication 
means according to the user's operation performed 
by means of the user interface. 

[0058] According to a twenty-fifth aspect of the 
present invention, in the second aspect of the present 
invention. 



[0054] According to the twenty-second aspect of the 
present invention, the function information has audio so 
data used for the user interface. This makes it possible 
to provide the user with appropriate audio information 
for each device and function and realize a user-friendly 
operational environment. 

[0055] According to a twenty-third aspect of the 35 
present invention, in the eleventh aspect of the present 
invention, 

the device GUI layer, the function GUI layer, or the 
sub-device GUI layer includes audio data for each 40 
of the classified categories, and 
the controller comprises audio reproducing means 
for reproducing audio as the user interface of the 
device, the function, or the sub-device for each of 
the categories through the use of the audio data. 45 

[0056] Accortfing to the twenty-third aspect of the 
present invention, the device GUI layer, function GUI 
layer, or sub-device GUI layer has audio data for each 
category, whereby appropriate audio information can be so 
provided to the user for each category. This sup- 
ports/fad Btates the user s understanding. 
[0057] According to a twenty-fourth aspect of the 
present invention, in the first aspect of the present 
invention. 55 

the function information includes a control code cor- 
responding to each of the functions of the device. 



the device comprises: 

storage means containing therein the function infor- 
mation including a control code corresponding to 
each of the functions of the device; 
communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, and making the device 
operate in accordance with the control code 
received from the controller with the communication 
means. 

[0059] The equipment according to the twenty-fifth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the twenty-fourth 
aspect of the present invention. 
[0060] According to a twenty-sixth aspect of the 
present invention, in the third aspect of the present 
invention, 

the controller comprises: 

communication means tor communicating with the 
device through the transmission fine; and 
control means tor acquiring from the device the 
function information including a control code corre- 
sponding to each of the functions of the device by 
transmitting a predetermined request to the device 
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with the communication means, and for controlling 
the device by transmitting the control code in the 
function information with the communication means 
according to the user's operation performed by 
means of the user interlace. 5 

[0061] The equipment according to the twenty-sixth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the twenty-fourth aspect of the w 
present invention. 

[0062] According to a twenty-seventh aspect of the 
present invention, in the first aspect of the present 
invention. 

is 

the function information includes display data rep- 
resenting each of the functions of the device, 
the device comprises: 

device communication means for communicating 
with the controller through the transmission line; 20 
and 

first control means for sending the function informa- 
tion to the transmission line with the device commu- 
nication means in response to a predetermined 
request received from the controller, and making 25 
the device operate in accordance with control infor- 
mation received from the controller with the device 
communication means, and 
the controller comprises: 

display means for the user interface ; 30 
controller communication means for communicat- 
ing with the device through the transmission line; 
ancL 

second control means for acquiring the function 
information from the device by transmitting the pre- 35 
determined request to the device with the controller 
communication means, for displaying each of the 
functions of the device with the display means 
through the use of the display data included in the 
function information, and for controlling the device 40 
by transmitting tfie control information on the basis 
of the function information with the controller com- 
munication means according to the user's operation 
by means of the user interface. 

45 

[0063] According to a twenty-eighth aspect of the 
present invention, in the second aspect of the present 
invention. 

the device comprises: so 
storage means containing therein the function infor- 
mation including display data representing each of 
the functions of the device; 
communication means for communicating with the 
controller through the transmission line: and 55 
control means for sending the function information 
to the transmission Bne in response to a predeter- 
mined request received from the controller with the 



communication means, and making the device 
operate in accordance with control information 
received from the controller with the cornmurticatron 
means. 

[0064] The equipment according to the twenty-eighth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the twenty-seventh 
aspect of the present invention. 
[0065] According to a twenty-ninth aspect of the 
present invention, in the third aspect of the present 
invention, 

the controller comprises: 
cfisplay means for the user interface; 
communication means for communicating with the 
device through the transmission line; and 
control means tor acquiring from the device the 
function information including display data repre- 
senting each of the functions of the device by trans- 
mitting a predetermined request to the device with 
the communicatfon means, for displaying each of 
the functions of the device with the display means 
through the use of the display data, and for control- 
ling the device by transmitting control information 
on the basis of the function information with the 
communication means according to the user's 
operation performed by means of the user inter- 
face. 

[0066] The equipment according to the twenty-ninth 
aspect of the present invention can be used as first 
equipment inducting the controller in the network control 
system according to the twenty-seventh aspect of the 
present invention. 

[0067] AccorcSng to a thirtieth aspect of the present 
invention, in the-twenty-seventh aspect of the present 
invention, 

the function information includes a control code cor- 
responding to each of the display date, 
the first control means in the device makes the 
device operate in accordance with the control code 
received from the controller with the device commu- 
nication means to realize a function represented by 
the display data corresponding to the control code, 
and 

the second control means in the controller displays 
each of the functions of the device with the display 
means through the use of file display data included 
in the function information acquired from the device 
with the .controller communication means, and 
transmits the control code corresponding to the dis- 
play data wfth the controller communication means 
accorcfing to the users operation performed by 
means of the user interface for the display data. 
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[0068] According to a thirty-first aspect of the present 
invention, in the thirtieth aspect of the present invention. 

the second control means in the controller, when 
any one of the display data is selected by the user 
based on display provided by the cfisplay means, 
transmits the control code corresponding to the 
selected cfisplay data with the controller communi- 
cation means. 

[00691 According to a thirty-second aspect of the 
present invention, in the thirtieth aspect of the present 
invention, 

the function information includes one or a plurality 
of control codes corresponding to each of the dis- 
play data. 

[0070] According to a thirty-third aspect of the present 
invention, in the twenty-seventh aspect of the present 
invention, 

the display data is data of a plurality of still pictures, 
and 

the display means in the controller sequentially dis- 
plays the plurality of still pictures through the use of 
the display data while switching the still pictures at 
a substantially constant time interval. 

[0071] According to the thirty-third aspect of the 
present invention, display data composed of data of a 
plurality of still pictures is included in the function infor- 
mation, and the controller sequentially displays the plu- 
rality of still picture data while switching the data at a 
substantially constant time interval. Thus, quasi -motion 
pictures can be displayed on the screen without an exe- 
cution code operating in the controller, and more easy- 
to-understand operational environment can be provided 
independently of the structure of the controller (the type 
of CPU and the fike). 

[0072] Accorcfing to a thirty-fourth aspect of the 
present invention, in the twenty-seventh aspect of the 
present invention. 

the display data is data of a plurality of still pictures, 
the function information includes display control 
information indicating a cfisplay method of the plu- 
rality of stifl pctures, and 

the cfisplay means in the controller cfispfays the plu- 
rality of stffl pictures through the use of the display 
data in accordance with the display control informa- 
tion. 

[0073] According to the thirty-fourth aspect of the 
present invention, cfisplay data composed of data of a 
plurality of stffl pictures and display control information 
indicating a display method of the plurality of stffl picture 
data are included in .the function information. This 



makes if possfcle to appropriately display quasi-motion 
pictures and still pictures according to each scene, and 
specify a reproducing speed and the like of the quasi- 
motion pictures. Consequently, the user can readily 
5 understand the intention of a creator of the user inter- 
face such as a GUI. 

[0074] According to a thirty-fifth aspect of the present 
invention, in the twenty-eighth aspect of the present 
invention, 

w 

the function information includes a control code cor- 
responding to each of the display data, and 
the control means makes the device operate in 
accordance with the control code received from the 
is controller with the communication means, to realize 
a function represented by the display data corre- 
sponding to the control code. 

[0075] The equipment according to the thirty-fifth 
20 aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to me thirtieth aspect 
of the present invention. 

[0076] According to a thirty-sixth aspect of the present 
25 invention, in the twenty-ninth aspect of the present 
invention, 

the control means acquires with the communication 
means the function information including the dis- 

30 play data representing each of the functions of the 
device and a control code corresponding to each of 
the display data, displays each of the functions of 
the device with the display means through the use 
of the display data, and transmits the control code 

35 corresponding to the display data with the commu- 
nication means according to the user's operation 
performed by means of the user interface for the 
display data, to control the device. 

40 [0077] The equipment according to the thirty-sixth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the thirtieth aspect of the present 
invention. 

45 [0078] According to a thirty-seventh aspect of the 
present invention, in the first aspect of the present 
invention. 

the function information includes audio data for the 
so user interface, 

the device comprises: 

device comrrtunication means for communicating 
with the controller through the transmission line; 
and 

55 first control means for sending the function informa- 
tion to the transmission line in response to a prede- 
termined request received from the controller with 
the device corrmtunication means, and making the 
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device operate in accordance with control informa- 
tion received from the controller with the device 
communication means, and 
the controller comprises: 

audio reproducing means for reproducing audio 5 
from audio data; 

controller communication means for communicat- 
ing with the device through the transmission line; 
and 

second control means for acquiring the function to 
information from the device by transmitting the pre- 
determined request to the device with the controller 
communication means, for reproducing audio with 
the audio reproducing means through the use of the 
audio data included in the function information, and 75 
for controlling the device by transmitting control 
information on the basis of the function information 
with the controller communication means according 
to the user s operation performed by means of the 
user interface. 20 

[0079J According to a thirty-eighth aspect of the 
present invention, in the second aspect of the present 
invention, 

25 

the device comprises: 

storage means containing therein the function infor- 
mation including audio data for a user interface; 
communication means for communicating with the 
controller through the transmission line; and 30 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, and making the device 
operate in accordance .with control information 35 
received from the controller with the communication 
means. 

[0080] The equipment according to a thirty-eighth 
aspect of the present invention can be used as second *o 
equipment including the device to be controlled in the 
network control system according to the thirty-seventh 
aspect of the present invention. 
[0081] According to a thirty-ninth aspect of the present 
invention, in the third aspect of the present invention, 45 

the controller comprises: 

awfio reproducing means for reproducing audio 
from audio data; 

corrmmication means for communicating with the so 
device through the transmission line; and 
control means for acquiring from the device the 
function information including the audio data for the 
user interface by transmitting a predetermined 
request to the device with the communication 55 
means, for reproducing audio with the audio repro- 
ducing means through the use of the audio data 
included in the function information, and for control- 



ling the device by transmitting control information 
on the basis of the function information with the 
communication means according to the user's 
operation performed by means of the user inter- 
face. 

[0082] The equipment according to a thirty-ninth 
aspect of the present invention can be used as first 
equipment incf ucfing the controller in the network control 
system according to the thirty-seventh aspect of the 
present invention. 

[0083] According to a fortieth aspect of the present 
invention, in the thirty-seventh aspect of the present 
invention, 

the function information includes the audio data for 
the user interface and reproduction control informa- 
tion indicating a reproduction method of the audio 
data, and 

the audio reproducing means in the controller 
reproduces audio in accordance with the reproduc- 
tion control information through the use of the audio 
data. 

[0084] AccorcSng to the fortieth aspect of the present 
invention, audio data and reproduction control informa- 
tion indicating a reproduction method of the audio data 
are included in the function information, which makes it 
possible to specify in detail the reproduction method of 
the audio data in addition to simply presenting audio 
and provide the user with optimal audio information 
according to scene. 

[0085] According to a forty-first aspect of the present 
invention, in the first aspect of the present invention. 

the device, when there occurs a change in the func- 
tion information, notifies the controller through the 
transmission line that the change occurs. 

[0086] According to the forty-first aspect of the 
present invention, when the status of the device 
changes, the change in the status is notified to the con- 
troller. This obviates the necessity for the controller to 
monitor the status of the device. Therefore, the traffic on 
the fransmission tine can be reduced, and the band of 
the transmission One can be effectively used, and more- 
over the load on the controller can be reduced. 
[0087] AccorcSng to a forty-second aspect of the 
present invention, in the second aspect of the present 
invention, 

the device comprises: 

storage means containing therein the function infor- 
mation; 

cxjrrimunicatkm means for communicating with the 
controller through the transmission fine; and 
control means for sending the function information 
to the transmission fine in response to the predeter- 
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mined request received from the controller with the 
communication means, notifies, when there occurs 
a change in the function information, the controller 
with the communication means that the change 
occurs, and making the device operate in accord- 5 
ance with control information received from the 
controller with the communication means. 

[0088] The equipment according to the forty-second 
aspect of the present invention can be used as second io 
equipment including the device to be controlled in the 
network control system according to the forty-first 
aspect of the present invention. 
[0089] According to a forty-third aspect of the present 
invention, in the third aspect of the present invention, is 

the controller comprises: 

communication means for communicating with the 
device through the transmission line; and 
control means for acquiring the function information 20 
from the device by transmitting a predetermined 
request to the device with the communication 
means, and for controlling the device by receiving, 
when a notification that the function information 
changes is transmitted from the device, the notifica- 25 
tion with the communication means, and transmit- 
ting control information on the basis of the function 
information with the communication means accord- 
ing to the user's operation performed by means of 
the user interlace. 30 

[0090] The equipment according to the forty-third 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the forty-first aspect of the present 35 
invention. 

[0091] According to a forty-fourth aspect of the 
present invention, in the first aspect of the present 
invention. 

40 

the device transmits, when there occurs a change 
in the function information, the changed information 
to the controller through the transmission line. 

(0092] According to the forty-fourth aspect of the <s 
present invention, when there occurs a change in the 
internal status of the device connected to the transmis- 
sion line, the device notifies the controller of the 
changed information. When receiving the notification, 
the controller can renew, for example, operational so 
screen display in response to the changed information 
as required. Thus, the user can reacfily see the change 
in the status in the device connected to the transmission 
line. 

[0093] According to a forty-fifth aspect of the present 55 
invention, in the second aspect of the present invention. 

the device comprises: 



storage means containing therein the function infor- 
mation; 

communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, transmitting, when there 
occurs a change in the function information, the 
changed information to the controller with the com- 
munication means, and making the device operate 
in accordance with control information received 
from the controller with the communication means. 

[0094] The equipment according to the forty-fifth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the forty-fourth 
aspect of the present invention. 
[0095] According to a forty-sixth aspect of the present 
invention, in the third aspect of the present invention, 

the controller comprises : 

communication means for communicating with the 
device through the transmission line; and 
control means for acquiring the function information 
from the device by transmitting a predetermined 
request to the device with the communication 
means, and for controlling the device by receiving, 
when changed information in the function informa- 
tion is transmitted from the device, the changed 
information to update the function information, and 
transmitting control information on the basis of the 
function information with the communication means 
according to the user's operation performed by 
means of the user interface. 

[0096] The equipment according to the forty-sixth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the forty-fourth aspect of the 
present invention. 

[0097] Accorcfing to a forty-seventh aspect of the 
present invention, in the first aspect of the present 
invention, 

the device comprises storage means that has a 
non-rewritable area and rewritable area and con- 
tains therein the function information in the non- 
rewritable area and rewritable area. 

[0098] Accorcfing to the forty-seventh aspect of the 
present invention, a non-rewritable area and rewritable 
area are included in area in the device where the func- 
tion information is stored. Thus, it is possible to provide 
not only information fixed to the device but also the infor- 
mation changing with time to the controller in a simple 
configuration. In this way. the changing information can 
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be speedily provided to the user. 
[0099] According to a forty-eighth aspect of the 
present invention, in the second aspect of the present 
invention, 

the device comprises: 

storage means that has a non-rewritable area and 
rewritable area and contains therein the function 
information in the non-rewritable area and rewrita- 
ble area; 

communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line with the communication 
means in response to the predetermined request 
received from the controller, and making the device 
operate in accordance with control information 
received from the controller with the communication 
means. 

{0100} According to a forty-ninth aspect of the present 
invention, in the forty-seventh aspect of the present 
invention. 

the device notifies, when information included in the 
function information and stored in the rewritable 
area changes, the controller that the information 
changes. 

[0101] According to the forty-ninth aspect of the 
present invention, when the contents in the rewritable 
area change, the device notifies the controller that the 
contents in the rewritable area change, which obviates 
the necessity for the controller to monitor the informa- 
tion about the device. As a result, the traffic on the trans- 
mission line and the load on the controller can be 
reduced. 

[0102] According to a fiftieth aspect of the present 
invention, in the forty-seventh aspect of the present 
invention. 

the storage means in the device stores a response 
to a request from the controPer in the rewritable 
area among the area where the function informa- 
tion is stored. 

[0103] According to the fiftieth aspect of the present 
invention, the device stores a response to the request 
from the controller in the rewritable area in the area 
where the function information of the device is stored. 
When there are a lot of responses, the device has only 
to write the responses in the rewritable area, and can 
omit the job such as splitting and transmitting the 
responses. As a result the load on the device can be 
reduced. 

[0104] According to a fifty-first aspect of the present 
invention, in the forty-seventh aspect of the present 
invention. 



tfie storage means in the device stores status infor- 
mation of the device in the rewritable area among 
the area where the function information is stored. 

s [01 05] According to the fifty-first aspect of the present 
invention, status information of the device is stored in 
the rewritable area in the area where the function infor- 
mation of the device is stored, which obviates the 
necessity for the controller to issue various commands 
w to confirm the status of the device. Therefore, it is pos- 
sible to fetch entire information about the controller at a 
time, and reduce the load on the controller and traffic on 
the transmission line. 

[0106] According to a fifty-second aspect of the 
is present invention, in the forty-seventh aspect of the 
present invention, 

the storage means in the device stores a flag indi- 
cating whether elements forming the function infor- 
20 matjon are stored in the rewritable area or in the 
non-rewritable area. 

[0107] According to the trfty-second aspect of the 
present invention, a flag indicating whether the constitu- 
25 ents (e.g. a directory) in the function information of the 
device are disposed in the rewritable area or in the non- 
rewritable area is provided. Accordingly, the controller 
can readily confirm whether information might be rewrit- 
ten or not for each of its constituents. Then, the control- 
30 ler has only to check only the information that might be 
rewritten, which reduces the load on the controller. 
[01 08] According to a fifty-third aspect of the present 
invention, in the first aspect of the present invention, 

35 the function information includes information indi- 
cating contents reproducible by the device. 

[0109] According to a fifty-fourth aspect of the present 
invention, in the second aspect of the present invention, 

40 

the device comprises: 

storage means containing therein the function infor- 
mation including information indicating contents 
reproducible by the device; 
45 communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
so communication means, and making the device 
operate in accordance with control information 
received from the controller with the comrnunication 
means. 

55 [01 1 0) According to a fifty-fifth aspect of the present 
invention, in me third aspect of the present invention. 

the controller comprises: 
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display means for the user interface; 
communication means for communicating with the 
device through the transmission line; and 
control means for acquiring from the device the 
function information including information indicating s 
contents reproducible by the device by transmitting 
a predetermined request to the device with the 
communication means, for displaying the informa- 
tion indicating the contents with the display means, 
and for controlling the device by transmitting control 10 
information on the basis of the function information 
with the communication means according to the 
user's operation performed by means of the user 
interface. 

is 

[0111] Accorcfing to a fifty-sixth aspect of the present 
invention, in the fifty-third aspect of the present inven- 
tion. 

the device notifies, when the contents reproductive 20 
by the device changes, the controller through the 
transmission line that new contents becomes repro- 
ducible. 

[0112] According to the fifty-sixth aspect of the 25 
present invention, when the contents reproducible by 
the device changes, the device notifies the controller 
that new contents becomes reproducible, which obvi- 
ates the necessity for the controller to monitor the con- 
tents information. Therefore, the toad on the controller 30 
can he reduced and the configuration can be simplified. 
[0113] According to a fifty-seventh aspect of the 
present invention, in the fifty-third aspect of the present 
invention, 

35 

the device transmits, when contents reproducible 
by the device change, information irxficating the 
contents which becomes newly repr oducMe to the 
controller through the transmission line. 

40 

[0114] Accorcfing to the fifty-seventh aspect of the 
present invention, when contents reproducible by the 
device change, the device transmits to the controller 
information indicating the contents which becomes 
newfy reproducible, which obviates the necessity for the 45 
controller to monitor the contents information and fetch 
the contents information that might frequently change. 
Consequently, the toad on the controller can be reduced 
and the configuration can be simpfified. 
[0115] Accorcfing to a fifty-eighth aspect of the present so 
invention, in the fifty-third aspect of the present inven- 
tion. 

the device comprises storage means having a 
rewritable area and containing therein the function 55 
information, and 

the storage means stores in the rewritable area the 
information indicating the contents reproducHe by 



22 

the device at present. 

[0116] According to the fifty-eighth aspect of the 
present invention, the device stores information about 
the contents reproducible at present in the rewritable 
area in the area in the device where the function infor- 
mation is stored. As a result, it is possible to readily and 
speedily fetch information which changes with time and 
the contents information to be a basis of the user's oper- 
ation of equipment. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0117] 

FIG. 1 is a block diagram showing a structure of a 
device in a network control system accorcfing to a 
first embodiment of the present invention; 
FIG 2 is a block diagram showing a structure of a 
controller in the network control system according 
to the first embodiment; 

FIG. 3 shows an exemplary configuration of the net- 
work control system according to the first embodi- 
ment; 

FIG. 4 illustrates an exemplary function list in the 
network control system according to the first 
. embodiment; 

FIG. 5 shows an exemplary structure of a support 
level/maximum transfer amount flag in the function 
list in the network control system according to the 
first embodiment; 

FIG. 6 shows an exemplary structure of a still pic- 
ture display flag in the function fist in the network 
control system according to the first embocfiment; 
FIG. 7 shows an exemplary structure of an audio 
reproduction flag in the function list in the network 
control system according to the first embodiment; 
FIG. 8 shows a structure of a function table which is 
an example of the function fist in the network control 
system according to the first embodiment; 
FIG. 9 aiustrates a function database in the network 
control system according to the first embocfiment 
FIG 1 0 illustrates a function fist in a network control 
system accorcfing to a second embodiment of the 
present invention; 

FIG 1 1 shows a structure of a function table which 
is an example of the function list shown in FIG. 10; 
FIG. 12 is a block diagram showing a structure of a 
device in a network control system accorcfing to a 
third embodirnent of the present invention; 
FIG 13 illustrates an exemplary function list in the 
network control system accorcfing to the third 
embodiment; 

FIG 14 shows a structure of an exemplary table 
state flag in the network control system accorcfing 
to the third embodiment; 

FIG 15 shows a structure of an exemplary function 
fist in the network control system accorcfing to the 
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third embodiment; and 

FIG. 16 shows exemplary operation in the network 
control system according to the first embodiment of 
the present invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0118] The present invention is described in detail 
below with referring to accompanying drawings. 

< First Embodiment) 

[0119] FIG. 1 is a block diagram showing a device in 
a network control system according to a first embed- 
ment of the present invention. 
[0120] It should be noted here that a device in the 
present description refers to an object to be controlled, 
and a controller controls the object. A plurality of 
devices may be included in one piece of equipment, and 
both of the device and controller or either one of them 
may be included in one piece of equipment Besides, 
one piece of equipment conesponds to one node on a 
transmission line. A plurality of nodes may be contained 
in one case to constitute an apparatus. 
[01211 In FIG. 1, a reference numeral 1 stands for a 
transmission line, 2 for a packet transmitter/receiver, 3 
for a synchronous data transmitter/receiver, 4 for a 
device signal processor, 5 for an asynchronous data 
transmitter/receiver, 6 for a device asynchronous data 
processor, 7 for equipment structure information. 8 for a 
function list, and 9 for an inside-of -equipment controller. 
[0122] Here, the transmission line t is, for example, a 
serial bus (hereinafter, referred to as a "1394 bus") 
defined by the IEEE standard 1394 (the IEEE standard 
1394-1995 and other higher level standards compatible 
therewith). The transmission line 1 is not necessarily the 
1394 bus. and may be ATM (Asynchronous Transfer 
Mode), the Ethernet, and any other transmission lines. 
[0123] The packet transmitter/receiver 2 physically 
and electrically interfaces to the transmission line 1, fur- 
ther arbitrates in bus-use rights, controls a synchronous 
transfer cycle, and so forth. Besides, the packet trans- 
mitter/receiver 2 selects a packet on the transmission 
line 1 according to a destination thereof to receive the 
packet, and transmits a packet onto the transmission 
linel. 

[0124] The synchronous data transmitter/receiver 3, 
when transmitting data, manages the transfer rates 
(splits the data) and adds a header to the data. For 
example, in the case where an AV protocd(IEC61883) 
standard of the 1394 bus is used, the synchronous data 
transmitter/receiver 3 adds a CIP (Common Iso- 
chronous Packet) header. On the other hand, when 
receiving data, the synchronous data transmit- 
ter/receiver 3 reananges received packets in right order, 
removes a header from the data, and so forth. 
[0125] The device signal processor 4 receives syn- 
chronous data from the synchronous data transmit- 



ter/receiver 3. and performs signal processing suited to 
the device. For example, in the case where the device is 
a recording player such as a digital VCR. the synchro- 
nous data is recorded into a storage medium (e.g. a 
5 magnetic tape). Moreover, the device signal processor 4 
fetches synchronous data from a storage medium, a 
broadcast wave and the like, then transmits the data to 
the synchronous data transmitter/receiver 3. and so 
forth. 

w [01 26] The asynchronous data transmitter/receiver 5 
performs transaction processing on asynchronous data 
in accordance with a protocol of a bus. For example, in 
the case where the 1 394 bus is used, the asynchronous 
data transmitter/receiver 5 performs processing of read 

is transaction, write transaction, lock transaction and the 
like. Note that the asynchronous data transmit- 
ter/receiver 5 may be a software. 
[0127] The device asynchronous data processor 6 
processes asynchronous data received from the asyn- 

20 chronous data transmitter/receiver 5. or communicates 
the asynchronous data to an appropriate constituent in 
the device. For example, in the case of receiving a com- 
mand as the asynchronous data, the device asynchro- 
nous data processor 6 judges the validity of the 

25 command, then provides the inside-of equipment con- 
troller 9 with an instruction corresponding to the com- 
mand when the command is valid. Besides, when the 
equipment structure information 7 is requested from the 
controller, the device asynchronous data processor 6 

30 sends information included in the equipment structure 
information 7 to the controller through the asynchronous 
data transmitter/receiver 5 in response to the request 
received through the asynchronous data transmit- 
ter/receiver 5 and the like. The device asynchronous 

35 data processor 6 further sends asynchronous data 
received from a constituent in the device to the asyn- 
chronous data transmitter/receiver 5 based on an 
instruction from the inside-of-equipment controller 9. 
Note that the asynchronous data transmitter/receiver 5 

40 and the device asynchronous data processor 6 may be 
constituted as one unit 

[0128] The equipment structure information 7 indi- 
cates information about a structure of the equipment, 
and is described, for example, under a rule specified by 

45 a configuration ROM in a CSR (Command and Status 
Registers) architecture of the ISO/IEC standard 
13213:1994. When the 1394 bus is employed, the 
equipment structure information 7 has information 
about a bus corresponding to the equipment such as 

so whether the equipment supports a bus manager and 
Isochronous operation, a unit directory including infor- 
mation about whether the equipment supports an AV 
protocol, a node ID which is an identifier of the equip- 
ment, and the like. In the equipment structure infer ma- 

55 bon 7, information indicating a location of the function 
fist 8 is described. 

[0129] The function fist 8 is a list of functions of the 
equipment, and is stored in predetermined memory 
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thereof as a function table in the form of a table, for 
example. The function list 8 has a function of the equip- 
ment, one or a plurality of commands corresponding to 
the function, and GUI (Graphical User Interface) infor- 
mation for notifying the user of the function and indicat- 5 
ing the status of the equipment when the user selects 
the function. Here, the commands are included in the 
function list 8 in the form where they can be interpreted 
and executed by the equipment, and are equal to con- 
trol codes which have a broader concept than normal w 
commands. That is, the commands are equivalent of 
control codes indicated by various identifiers peculiarly 
specified for the equipment as well as control com- 
mands such as standardized commands and com- 
mands peculiar to the equipment The information of the / 5 
function list 8 is transferred to the controller on the trans- 
mission line 1 through the device asynchronous data 
processor 6, the asynchronous data transmit- 
ter/receiver 5 and the like in response to a request from 
the controller. 20 
[0130] The inside -of- equipment controller 9 controls 
each of its constituents including the inner workings of 
the device and the like. In the case where the device 
asynchronous data processor 6 receives a command as 
data, the inside-of- equipment controller 9 controls the 25 
constituents based on an instruction from the device 
asynchronous data processor 6 so that the constituents 
operate in accordance with the command. For example, 
in the case where the device is a VCR, and the received 
command is a PLAY command, the inside-of-equipment 30 
controller 9 sequentially instructs the VCR to perform - 
operation such as rotating a drum of the VCR at the pre- 
determined number of revolutions, moving a tape at a 
given speed, fetching a signal from a head on the drum 
to send the signal to the device signal processor 4. and 35 
the like. 

[0131] Operation of the device in response to a 
request and the like from the controller is desert) ed as 
follows: When the function list 8 is requested from the 
controller, the device presents the function list 8 to the 40 
controller. When received a command from the control- 
ler, the device performs processing for the command 
according to the circumstances. Thus, the device has 
only to present the function list 8 in response to the 
request for GUI information from the controller, thereby 45 
making it possible to decrease the load on the device. 
[01 32] It should be noted that the constituents such as 
the synchronous data transmitter/receiver 3, the device 
signal processor 4 and the fike may be operationally 
included depending on the functions of the device, or so 
may be omitted 

[01 33] Moreover, the equpment structure information 
7 and the function list 8 of the device are generally op- 
posed in a non-rewritabfe memory area, however, may 
be disposed in a rewritable memory area such as a 55 
flash ROM. 

[0134] Furthermore, each part of the device may be 
formed by either of hardware or software. 



[01 35] FIG. 2 is a block diagram showing/the controller 
in the network control system according to the present 
embodiment Here, reference numerals 10 to 14 repre- 
sent a controller signal processor, a controller asynchro- 
nous data processor, a function list managing portion, a 
function database, and a screen display/equipment 
function selection portion, respectively. Note that in FIG. 
2, the same constituents as those in FIG. 1 are 
assigned the same numerals, and the description 
thereof is omitted here. 

[0136] The controller signal processor 10 receives 
synchronous data from the synchronous data transmit- 
ter/receiver 3 to perform signal processing suitable for 
the controller. For example, in the case where the con- 
troller is a video display such as a video monitor, the 
controller signal processor 10 decodes the synchronous 
data (e.g. a stream of MPEG2) and displays the data on 
the screen. 

[0137] The controller asynchronous data processor 1 1 
processes asynchronous data received from the asyn- 
chronous data transmitter/receiver 5, or communicates 
the data to an appropriate constituent of the controller. 
In the case where the received asynchronous data is a 
command, the controller asynchronous data processor 
1 1 judges the validity of the command, and when the 
command is valid, provides the screen display/equip- 
ment function selection portion 14 with an instruction 
corresponding to the command. Besides, the controller 
asynchronous data processor 11 receives from the 
packet transmitter/receiver 2 via the asynchronous data 
transmitter/receiver 5 information about devices on the 
transmission line 1 such as connection of a new device, 
disconnection of an existing device and the like and the 
function list 8 of each device, and communicates them 
to the function list managing portion 12. Furthermore, 
the controller asynchronous data processor 1 1 sends 
asynchronous data from the constituent of the device to 
the asynchronous data transmitter/receiver 5 based on 
an instruction from the screen tispfay/equipment func- 
tion selection portion 14. Note that the asynchronous 
data transmitter/receiver 5 and the controller asynchro- 
nous data processor 1 1 may be constituted as one unit. 
[01 38] Moreover, in the case where the controller and 
the device are included in the same equipment the 
functions of the device in the equipment are listed in the 
function list 8 of the device, but not registered in the 
function database 13 in the equipment since the control- 
ler grasps the functions of the device, or the inside-of- 
equipment controller 9 directly controls the inside of the 
equipment At this time, it is obvious that the location of 
the function list 8 may be described in the equipment 
structure information 7 and ateo previously registered in 
the function database 13. 

[0139] ft should be noted that in the case where the 
controller and the device are included in the same 
equipment the controller signal processor 10 and the 
device signal processor 4. and the controller asynchro- 
nous date processor 1 1 and the device asynchronous 



4M 



27 



EP0 939 517 A1 



28 



data processor 6 may be respectively constituted as the 
same unit. 

{0140] The function list managing portion 1 2 manages 
information of the function list 8 received from the 
device on the transmission line 1. When received from s 
the controller asynchronous data processor 1 1 informa- 
tion indicating that a new device is connected, the func- 
tion fist managing portion 12 instructs the controDer 
asynchronous data processor 1 1 to read the function fist 
8 of the new device. Then, when the function fist 8 of the w 
new device is read, the function fist managing portion 12 
registers the information of the function list 8 in the func- 
tion database 13. Moreover, when received information 
indicating, for example, that an existing device on the 
transmission line 1 is disconnected, the function list is 
managing portion 12 deletes the corresponding function 
list 8 from the function database 13. When an existing 
device is disconnected, it may be also possible that the 
information of Hs function list 8 is saved in a storage (not 
shown in the drawing) in the controDer instead of being 20 
deleted, and thereby, when the device is connected 
again, the device is identified with the identifier of the 
device and the like, and then the information of the func- 
tion list 8 is read from the storage in the controller and 
registered in the function database 13. In this way. reg- 2s 
istration of the connected devices can be expedited. 
[0141 J -.- The function database 13 is disposed in a 
rewritable memory space, and constructed through the 
use of the function list 8 received from the device as a 
database. The database is consulted using the informa- 30 
tion in the function list managing portion 12. thereby 
making it possible to fetching information about each 
device and function and a command corresponding to 
the function and the GUI information for notifying the 
user of the function and representing the status of the 35 
equipment when the user selects the function. 
101 42J The screen display/equipment function selec- 
tion portion 14 notifies the user of the GUI information 
about the device and function and the fike by means of 
video/audio/character information and the tfte repre- 40 
senting the GUI information displayed on the screen of 
the controller, selects a device and function in accord- 
ance with the user's operation, makes an instruction for 
execution of each function, and so forth. Besides, the 
screen display/equipment function selection portion 14 45 
can reproduce/display date (e.g. video and audio data) 
received from the controller signal processor 10 and 
data received from the controller asynchronous data 
processor 11. At this time, the GUI information and the 
like, when Displayed, may overlay the video data so 
received from the controller signal processor 10. Alter- 
natively, screen display for the GUI information and 
screen display for the video data may be alternately 
switched based on the user's instruction and the like. 
10143] Furthermore, in the case that the screen dis- ss 
play/equipment function selection portion 14 provides 
an instruction to the function fist managing portion 12 to 
retrieve the information of the function list 8. thereby dis- 



playing on the screen graphics representing the device 
on the transmission line 1 and the function thereof (a 
device name, a function name, a still picture sequence 
for display and the like). Then, when the user selects 
graphics representing a function, the screen dis- 
play/equipment function selection portion 14 replaces 
the graphics with graphics for a selected occasion 
obtained from the information of the function list 8 to dis- 
play the same, and indicates to the user that the func- 
tion is selected by reproducing audio data for a selected 
occasion, whereby the user's operation can be sup- 
ported. Then the screen display/equipment function 
selection portion 14 issues a command corresponding 
to the function obtained from the information of the func- 
tion list 8 through the controller asynchronous data 
processor 1 1 and the like. The screen display/equip- 
ment function selection portion 14 receives via the con- 
troller asynchronous data processor 1 1 a response from 
the device to the command and a status of the device to 
which the instruction is made, then obtains graphics 
data and audio data suitable for the status of the device 
and the fike from the information of the function fist 8. 
and displays graphics on the screen or reproduces 
audio to notify the user. 

[0144] Here, it is not always necessary for the control- 
ler to understand each function of the device. For exam- 
ple, as to a device having a new function not 
conceivable at present, the controller fetches graphics 
data and audio data for the new function from the infor- 
mation of the function list 8 and thereby displays graph- 
ics on the screen or reproduces audio, to notify the user. 
Then, when the user understands the new function from 
the graphics or audio and selects the function, the 
screen display/equipment function selection portion 14 
in the controller refers to the function list 8, then obtains 
a command corresponding to the new function, and 
issues the command to the device. As a result, it is pos- 
sible to execute the new function in the device. Thus, the 
above structure enables the user to perform a new func- 
tion not conceivable at present. 
[0145) It should be noted that the constituents such as 
the synchronous data transmitter/receiver 3 and the 
controirer signal processor 10 may be included option- 
ally according to the function of the controller, or may be 
omitted. 

[0146] FIG. 3 shows the system configuration of the 
network control system of the present embodiment. 
[0147] In FIG. 3, a reference numeraJ 21 stands for a 
television set (TV), 23 for a remote controller for the tel- 
evision set 22 for a personal computer (PC), 31 for a 
DVD-format optical disk capable of recording and repro- 
ducing (DVD), 32 for a DV digital VCR (DVC), 33 for a 
VHS cSgitaf VCR (DVHS). 34 for a DV digital movie cam- 
era (DVC movie), and 35 for a set-top box (STB) for CS 
digital broadcast and the like. The above-described 
equipment is collectively referred to as 
vtdeo/audto/information equipment The 

videcVaucSo/intormation equipment is interconnected 



1C 



29 



EP 0 939 517 A1 



30 



with the transmission line 1 to constitute an AVC sys- 
tem. The video/autfio/information equipment should not 
be limited to the above equipment and includes cur- 
rently-used equipment (eg. a printer, a mini-disk and 
the like) and aO equipment to come in the future in each 5 
of video, aucfio and information fields. 
[0148] The television set 21 is constituted by a control- 
ler and a device (a terrestrial broadcasting wave tuner 
and a video monitor). The user provides an instruction 
to the screen display/equipment function selection por- w 
lion 14 in the television set 21 with the remote controller 
23. The PC 22 is constituted by a controller and a device 
(a modem interfacing with a telephone line, a video 
monitor and the like). The user provides an instruction 
to the screen display/equipment function selection por- 15 
tion 14 in the PC 22 with a keyboard, a mouse and the 
like. The television set 21 and the PC 22 are defined 
here as equipment in which the devices and controllers 
are combined in one. Among the functions of each 
device in the equipment, a function which can be used 20 
by other equipment is described in the function list 8. A 
function of the equipment, however, is not registered in 
the function database 13 in the controller in the equip- 
ment. Note that the television set 21 and PC 22 may be 
defined as equipment constituted by two devices and a 25 
controller and have the function list 8. for each device in 
the equipment, which is registered in the function data- 
base 13 in the controller in the equipment. 
[0149] The DVD 31 and DVC movie camera 34 are 
devices capable of recording and reproducing AV data, so 
The DVC 32 and DVHS 33 are equipment each con- 
sisted of a device capable of recording and reproducing 
AV data and a device having the function of a digital 
broadcast tuner. The STB 35 is a device having the 
function of a tuner tor receiving CS* digital broadcast. 35 
10150] While the DVD 31. DVC 32. DVHS 33. DVC 
movie camera 34 and STB 35 are defined as devices 
here, they may be defined as equipment inducing con- 
trollers and devices regardless of the size if they can 
realize an environment for operating other devices on a 40 
liquid crystal panel and the like thereof and a user can 
perform operation such as selecting a function of other 
devices by means of a touch panel, a remote controller 
and the fike thereof. Alternatively, rt is also possible that 
each equipment has a processing function as a control- 45 
ler and a remote controller for itself, and lets a monitor 
display images and reproduce audio by means of ana- 
log connection, to enable the user to operate the equip- 
ment by manipulating the remote controller wrtHe 
viewing a screen of the monitor. In this case, the equip- so 
ment may be identified as equipment including a con- 
troller and a device. 

(0151 J FIG. 4 illustrates the function list 8 accorcSng to 
the present embodiment. 

(0152) In FIG. 4, reference numerals 41 to 44 repre- 55 
sent a device information layer, a function information 
layer, a function GUI information layer, a device GUI 
layer, respectively. The function fist 8 has a tree struc- 



ture with nodes of directories or leaves described later. 
[01 53] The function list 8 is mainly composed of two 
layers of the device information layer 41 and the func- 
tion information layer 42. and the device GUI layer 44 
and the function GUI layer 43 are further added to the 
device information layer 41 and the function information 
layer 42, respectively. First, the device information layer 
41 shows information about a device, that is, formed by 
attribute information including device identification infor- 
mation, specifically, a device name expressing a 
generic name tor the device in a character string, a 
device type expressing a type of the device in a code, a 
model name expressing a model of the product speci- 
fied by a manufacturer in a character string, a unique ID 
representing the device and varying with device, and 
the tike. Here, the device name may be expressed in a 
code, the device type may be a code or a character 
string expressed by subunrtjype of AV/C Digital Inter- 
face Command Set (AV/C-CTS) discussed by the 1394 
TA (1 394 Trade Association), and the unique ID may be 
node_yendor_id or chipjd defined by the 1394 bus. 
[01 54) Note that the device information layer 41 has 
even information about the function list 8. and describes 
therein a support level of the function list 8, a table size 
in case of realizing the function list 8 in a table form, a 
maximum transfer amount which the device can trans- 
mit in one asynchronous transfer, and the like. The con- 
troller can thus decide only by looking this layer, before 
reading the entire function list 8. whether or not the con- 
troller can support the level of the function list 8. how 
much of the memory space the controller must reserve 
for the function list 8. what amount the controller should 
transfer per one transfer, for example. This makes it 
possible to eliminate unnecessary transfer. 
[0155] FIG. 5 is a block diagram showing an exem- 
plary support level/maximum transfer amount flag. 
Here, a reference numeral 51 stands tor a support 
level/maximum transfer amount flag. In the support 
level/maximum transfer amount flag 51. the first one 
byte (04H in FIG. 5; H means hexadecimal notation) is 
an identif ier indicating the support level/maximum trans- 
fer amount flag 51 . The next one byte "LL" expresses in 
a code the level which the function fist 8 supports. The 
level here is obtained by classification, for example, 
according to the information included in the function list 
8. and determined based on whether or not a plurality of 
still pictures are included in the GUI information, 
whether or not aucfio data is included therein, and 
whether an execution code executable by the controller 
is included therein. The last two bytes "SS" represent a 
maximum transfer size that the device having the func- 
tion fist 8 can transmit in one transfer, and are 
expressed by hexadecimal bytes denoting the maxi- 
mum transfer amount The maximum transfer size 
which can be transmitted in one transfer may be of 
course expressed in a code 

[0156] Next the function information layer 42 indi- 
cates the functions of the device, and is formed, for 
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each function that the device supports, by afunction 
name expressing the function in a character string, a 
function type expressing a type of the function in a code, 
a function ID for identifying each function, one or a plu- 
rality of commands corresponding to the function, and 5 
the H<e. Here, the function type may be a character 
string. In example of foe DVC, the DVC has the func- 
tions such as reproduction, record, stop, fast-forward, 
fast-reverse, still, triple-speed reproduction and the like, 
and creates a directory for each function- In the direc- 10 
tory, a function name, a function type, a function ID. a 
command and the like are described. The function type 
includes, for example, reproductioa record, tape opera- 
tion and the like. The command includes one or a plural- 
ity of combinations of a command defined by the AV/C- t5 
CTS, a vendor's unique command and the like, for 
example. The function ID is an identifier having individ- 
ual numbers varying with function in the device. It is 
obvious that the function ID may be differently assigned 
to devices having the same function type, whereby each 20 
function can be identified with the function type and the 
function ID. It should be noted here that even in a device 
having a new function not conceivable at present, a 
directory for the new function is created in the function 
information layer 42. 25 
101 57] The function GUI layer 43 indicates user inter- 
face information about each function. In the function 
GUI layer 43. the directories for individual functions 
obtained by classification in the function information 
layer 42 are further classified according to user's opera- 30 
tion and the status of the device. A directory is then cre- 
ated for each category resulting from the classification, 
which includes therein a GUI type expressing a GUI 
type in a code, a stHi picture display flag, a still picture 
sequence for cSsplay composed of one or a plurality of 35 
still pictures, an audio reproduction flag, audio data and 
the like. Here, the GUI type includes, for example, "dis- 
played on screen" used when the function is displayed 
on the screen of the controller, "selected" used when 
the function is selected on the controller screen, "exe- 40 
cuted" used during the function is being executed by the 
device, "error' used when the device does not accept a 
command corresponding to the function from the con- 
troller, and the like. Besides, in the case where a new 
function happens to be a function not conceivable at 45 
present it is possible to provide the user with informa- 
tion about the new function by disposing a still picture 
and audio data representing the new function in the 
function GUI layer 43 to transmit the data of the new 
function to the controller. 50 
[0158] FIG. 6 is a block diagram showing an exem- 
plary still picture cfeplay flag as display control informa- 
tion for reproducing a still picture. Here, a reference 
numeral 52 is a stffl picture display flag. In the still pic- 
ture display flag 52, the first one byte (19H fn FIG. 6) is 55 
an identifier indicating the stffl picture display flag 52. 
and me next one byte "KK" indicates the number and 
the presence or absence of stiQ pictures. The next one 



byte "MM" indicates a method of displaying the still pic- 
ture sequence for display, and express in a code, for 
example, whether the still picture sequence for display 
is displayed in only one cycle or repeatedly, or only the 
first still picture is displayed, and the like. The last one 
byte "PP" indicates a display interval between still pic- 
tures of the still picture sequence for display. The last 
one byte "PP" is expressed/for example, by multiples of 
30 (msec), and only the multiple part is descrfoed. 
Therefore, in the case where a plurality of still pictures in 
the still picture sequence tor display are displayed, the 
still pictures are sequentially switched at the cfisplay 
interval to be displayed on the screen of the controller 
as quasi-motion pictures. 

[0159] FIG. 7 is a block diagram showing an exem- 
plary audio reproduction flag as reproduction control 
information for reproducing audio. Here, a reference 
numeral 53 is an audio reproduction flag. In the audio 
reproduction flag 53. the first one byte (17H in FIG. 7) is 
an identifier indicating the audio reproduction flag 53. 
and the next one byte "AA" indicates the presence or 
absence of audio data. The next one byte "BB" indicates 
a method of reproducing audio data, and expresses in a 
code, for example, whether audio data is reproduced 
only once or repeatedly. It is also possible to specify a 
reproduction interval of audio data in the audio repro- 
duction flag 53 for prompting user's operation. 
{0160] In FIGS. 5 to 7, the identifier of each flag is 
described in accordance with the CSR architecture of 
the ISO/IEC 13213:1994 standard, and as the first two 
bits of the identifier of each flag, keyjype of the CSR 
architecture is used. 

[0161] The device GUI layer 44 is a hierarchy indicat- 
ing user interlace information of the device, and is clas- 
sified according the user's operation and the status of 
the device. Each category resulting from the classifica- 
tion has a GUI type expressing a type of GUI in a code, 
the strll picture display flag 52, a still picture sequence 
for display composed of one or a plurality of still pic- 
tures, the audio reproduction flag 53, audio data and the 
like The GUI type here includes, for example, "displayed 
on screen" used when the device is tispJayed on me 
screen of the controller, "selected" used when the 
device is selected on the controller screen, "in opera- 
tion" used during the device is in operation, "in use" 
used when the device is used by another controller, 
•error" used when the device does not accept an 
instruction from the controller, and the like 
[0162] FIG. 8 is a diagram showing a function table 
which is an example of the function Bst 8 in the present 
ernbocfiment In FIG. 8, an address space in memory is 
expressed by a portrait format rectangle, and 4 bytes 
wide. The "Length" in the drawing expresses a size of 
contents of a cfirectory or leaf equivalent of individual 
nodes forming a tree structure of the function Bst 8 as 
multiples of 4 bytes, and "CRC" is cyclic redundancy 
check bits. Note that the addresses here are assigned 
for convenience in explanation and therefore can be 
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arranged arbitrarily, or the constituents may be respec- 
tively identified with identifiers. 

[0163] The directory beginning with "Address=430K\ 
for example, is equivalent of a unit Directory of the CSR 
architecture, and defines therein a function table entry s 
indicating a location of the function fist 8 (Address = 
440 H)- Information in an area from Address = 430H to 
440H is included in the equipment structure information 
7. 

[0164] The information of the function Dst 8 is 10 
described in Address = 800H and thereafter. The device 
information layer 41 ts disposed in an area from 
Address 800H to an address just before Address = 
900 H. the function information layer 42 in an area from 
Address = 900H to an address just before Address = is 
AOOH, and the function GUI layer 43 in an area from 
Address = AOOH and thereafter. 
[0165] In FIG. 8. each of the function table entry, the 
device name entry and the like has an identifier for iden- 
tifying an entry type thereof in the first one byte, and 20 
indicates a relative address value to each directory or 
leaf in the remaining three bytes. Note that key_type of 
the CSR architecture is used as the first two bits of the 
identifier. 

[0166] In this way, the directory structure reserving a 25 
variable area for each category such as a function. GUI 
and the like and for each constituent is constructed. 
This makes rt possible to effectively use a memory area 
storing the function list 8 and readily retrieve each cate- 
gory and constituent. 30 
[0167] While an area from Address = 800H to an 
address just before Address = 900H is defined as the 
device information layer 41 here, some of information 
included in the device information layer 41 may be 
described in a part of the equipment structure informa- 35 
tion 7. and in this case, the device information layer 41 
is formed by a plurality of directories. Similarly, the other 
layers may be respectively formed by a plurality of direc- 
tories if the relation between layers is dear 
[01 68] FIG. 9 frustrates the function database in the <o 
first embodiment. Referring to FIG. 9. the operation of 
the controller is described. 

[0169] In FIG. 9. when a device is connected to the 
transmission line 1 . a controller on the transmission fine 
recognizes the new device by means of bus reset and as 
the Ifoe in the case of the 1394 bus. for example, then 
reads the function list 8 from the new device through the 
transmission line 1 according to an instruction from the 
function fist managing portion 12. and copies and regis- 
ters the function list 8 into the function database 13 in so 
the controller. Here, the function fist 8 is identified with a 
memory address in which the function list 8 is disposed, 
the unique ID and the like, and has a directory structure 
having an entry for each device 

[0170] The screen display/equipment function selec- 55 
tion portion 14 refers to information of the function list 8 
in the function database 13 through the function list 
managing portion 12. When the screen display/equip- 



ment function selection portion 14 displays a list of 
devices connected to the controller according to an 
instruction such as the user's operation of the remote 
controller, the screen display/equipment function selec- 
tion portion 14 reads the device name and device type 
in the device information layer 41. the still picture 
sequence for display in the device GUI layer 44. and the 
like from the function fists 8 of all devices registered in 
the function database 13 through the use of information 
in the function fist managing portion 12. and displays 
the same on the screen. Here, the devices are identified 
with the memory addresses in which their function lists 
8 are disposed, their unique IDs and the like. All infor- 
mation in the device information layer 41 is not neces- 
sarily displayed on the screen, of course, and may be 
appropriately selected and displayed. Besides, accord- 
ing to the usage condition of each equipment, the still 
picture sequence for display and the like for the used 
occasion may be read from the device GUI layer 44 and 
displayed on the screen, thereby provirJng a more user- 
friendly device list Here, the audio data in the "dis- 
played on screen* category in the device GUI layer 44 is 
not used in displaying the device fist For example, when 
a new device is connected while the device list is dis- 
played, the still picture sequence for display of the new 
device is displayed and the audio data in the "displayed 
on screen" category is reproduced. 
[0171] Next, in the case that the user selects, for 
example, the DVC having the unique ID "YYY1" with a 
pointing function (e.g. a cross key) of the remote con- 
troller 23 and the like, the screen display/equipment 
function selection portion 14 reads the still picture 
sequence for display for the selected occasion and the 
like in the device GUI layer 44, and displays the same 
on the screen in accordance with the still picture display 
flag 52. Then, the screen display/equipment function 
selection portion 14 reads the still picture sequence for 
display in the function GUI layer 43 for each function 
described in the function information layer 42 from the 
function list 8 of the device with using the function fist 
managing portion 12. and displays the same on the 
screen based on an instruction of the still picture display 
flag 52. Graphics representing all functions of the 
device is thus displayed on the screen. Here, the 
respective functions are identified with the function ID in 
the function information layer 42 and the memory 
addresses in which the function information is disposed, 
and the types of GUI are identified with the GUI type 
and the memory addresses in which the various types 
of GUI information are disposed. Of course, it is also 
possible to define IDs for GUI and then uniquely assign 
the numbers to the various types of GUI to manage the 
types. This facflitates the management and enables a 
prfuraftty of functions to share a GUI. whereby memory in 
the equipment can be reduced. Here, since each func- 
tion has screen display data, it is possWe to flexibly 
cope with the case where the enough space for display- 
ing the screen display data of all functions can not be 
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reserved due to constraints such as relation with other 
display items and resolution of the screen, by displaying 
only the function names but not the graphics as for 
some functions, changing the layout relation among the 
graphics of functions, and so forth. 5 
10172] Furthermore, in the case where the user moves 
a cursor onto the graphics representing a reproduction 
function of the device, for example, by means of the 
pointing function of the remote controller, the screen 
display/equipment function selection portion 14 fetches 10 
audio data in the "displayed on screen" category in the 
function GUI layer 43 whose function information layer 
is for reproduction from the function list 8 of the device 
while using the function list managing portion 12 again, 
reproduces the audio data based on the instruction of is 
the audio reproduction flag 53. The audio data may be 
audio for explaining the function, some melody, or audio 
indicating a selection method, for example. Here, in the 
case where the user moves the cursor onto the graphics 
representing the reproduction function, the screen dis- 20 
play/equipment function selection portion 14 repro- 
duces audio data not immediately but only when the 
cursor has been still located on this position even after 
a lapse of time (e.g. almost a second) required to pre- 
dict that the user's intention is directed to the function. 25 
10173] - Next, in the case where the user selects the 
graphics representing the reproduction function of the 
device, for example, by means of the pointing function of 
the remote controller and the like, the screen dis- 
play/equipment function selection portion 14 fetches 30 
one or a plurality of commands corresponding to the 
function from the function list 8 of the device, and 
sequentially transmits the commands to the device. The 
command here is a command indicating a function, 
function ID of the function, identifier of the graphics, or 35 
the like. The screen display/equipment function selec- 
tion portion 14 then monitors the status of the device, 
and when an operation mode of the device becomes a 
desired operation mode (here, the reproduction status), 
displays a reproduced picture from the device on the 40 
screen. At the same time, the screen display/equipment 
function selection portion 14 fetches the selected stHJ 
picture sequence for display and audio data tor the 
selected occasion in the function GUI layer 43 whose 
function information layer 42 is for reproduction tunc- 45 
tion. flien displays the still picture string tor display over 
the graphics representing the reproducing function in 
the manner indicated by the stifl picture display flag 52. 
and replays the audio data based on the instruction of 
the audio reproduction flag 53. The audio data may be so 
audio for explaining me operation of the function and the 
state of the device, or some melody. While the status of 
the device is monitored here, when the status of the 
device changes, the device asynchronous data proces- 
sor 6 and the inskie-of equipment controller 9 in the 55 
device may notify the change in the status to the control- 
ler which transmits a command causing the change. In 
this case, the controller does not have to monitor the 



status of the device, thereby reducing the traffic on the 
transmission line 1. Consequently, the band of the 
transmission line 1 can be effectively used and the load 
on the controller can be reduced. 
[0174] Moreover, in the case where the device can not 
accept the command transmitted by the controller for 
some reason, the screen display/equipment function 
selection portion 14 senses that the device does not 
accept the command based on the response to the 
transmitted command, the result of the monitoring of the 
device status and the fike. The screen display/equip- 
ment function selection portion 14 then fetches the still 
picture sequence for display and audio data for the error 
occasion in the function GUI layer 43 whose function 
information layer 42 is for reproduction function, then 
displays the still picture sequence for display over the 
position of the graphics representing the reproduction 
function in the manner indicated by the still picture Dis- 
play flag 52, and at the same time, reproduces audio 
data based on the instruction of the audio reproduction 
flag 53. The audio data may be sound for explaining the 
status of the device, some beep tones, or some melody, 
for example. While the still picture sequence tor display 
for the error occasion is Displayed over the position of 
the graphics representing the reproduction function 
here, it may be widely cfisplayed in a conspicuous posi- 
tion such as a center of the screen. 
[0175] Afl screen display data and audio data as for 
each device and function is transferred from the device 
in the present invention. However, in the case where 
varying screen display data is received from a plurality 
of DVCs. for example, as tor a common function among 
the DVCs. screen display data for the function existing in 
the function list 8 of any one of the DVCs may be used, 
and as for a function unique to a DVC, screen display 
data in the DVC may be used. Moreover, the controller 
may previously have screen display data for a general 
function therein, to use the screen display data for the 
general function. While the description was made with 
an example of screen display data here, audio data may 
be of course used similarly. In this way, screen display 
data for a function and device is shared among some 
devices, which makes it possible to keep consistency of 
screen display provided by the controller and display at 
the time of operation. 

[0176] Furthermore, while the screen display/equip- 
ment function selection portion 14 perform its display 
and reproduction operation in accordance with the still 
picture display flag 52 and audio reproduction flag 53 
here, the screen cSsplay/equipment function selection 
portion 14 may specify display and reproduction meth- 
ods by itself in advance, or determine display and repro- 
duction methods with referring to the still picture Display 
flag 52 and audio reproduction flag 53. The screen dis- 
play/equipment function selection portion 1 4 thus deter- 
mines r^splayingyreprocUjcrion methods, thereby 
keeping consistency of the operational environment. 
[0177] It should be noted that one or some of the 
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device information layer 41, the function information 
layer 42. the function GUI layer 43. and the device GUI 
layer 44 may be omitted according to the abifity and 
function and the like of the equipment as required. 
(0178) FIG. 16 shows an exemplary operation in the 5 
network control system in the present embodiment. 
(0179J In the network control system in the present 
embodiment, when a device is newly connected to the 
transmission line 1. the controller 1 recognizes the new 
device, for example, by means of bus reset and the like w 
in the case of the 1394 bus, and transmits a function Pst 
read request through the transmission line 1 to the new 
device. In response to the request, in the new device, 
the device asynchronous data processor 6 receives the 
request via the asynchronous data transmitter/receiver is 
5 and the like, and transmits the information of the func- 
tion list 8 via the asynchronous data transmitter/receiver 
5 and the tike to the controller. Note that the controller 
may read the function list 8 from the device through the 
transmission line together with the function list read 20 
request. 

[0180J The controller thus acquires the information of 
the function fist 8 from the new device, then copies and 
registers the information of the function list 8 to/in the 
function database 13. After the information of the func- 25 
tion list 8 is registered, the screen display/device func- 
tion selector 14 of the controller displays the operational 
screen display through the use of the GUI information 
corresponding to the new device, the GUI information of 
the function and the like. Thus, the graphics represent- 30 
ing the new device and the function thereof is displayed 
on the screen in addition to the graphics representing 
the devices already registered in the function list 8 and 
the functions thereof. 

[0181] The user operates with respect to the opera- 35 
tiona! screen display in the controller obtained in the 
above manner to select a function of a predetermined 
device provided on the operational screen display, 
whereby a control code corresponding to the function is 
issued to the selected device. That is, the screen dis- 40 
play/device function selector 14 retrieves a control code 
corresponding to the graphics and the like manipulated 
by the user from the function database, and transmits 
the control code, instructing the device to execute the 
function represented by the graphics, to the selected 45 
device. The device which receives the control code 
interprets and executes the instruction indicated by the 
control code. Specifically, the operation specified by the 
control code is executed by the inside-of- equipment 
controller 9. After the operation is executed, the device 50 
transmits a response to the issued instruction to the 
controller. The controller receives the response to rec- 
ognize that the issued instruction is properly performed, 
and renews the operational screen cf splay as required. 
In the case of receiving the response indicating occur- 55 
rence of an enor such as the case that the instruction is 
not properly performed in the device, the controller 
fetches the still picture sequence for display and the like 



for the error occasion from the function fist 8 of the 
device, and thereby displays an error indication with 
using the same. 

[0182] Communications made between the controller 
and the device through the transmission line 1 in the 
above way enables the user to make an instruction in 
the operational screen display for the device connected 
to the transmission line including a newly-connected 
device. In response to the instruction, the device is con- 
trolled with the function fist to perform the function 
desired by the user. During such operation, when a 
change occurs in the internal status of the device con- 
nected to the transmission line 1 , the device notifies the 
controller of information in which the change occurs by 
means of a predetermined identifier, for example. Upon 
receiving the notification, the controller deals with the 
change in information, and renews the operational 
screen display as required. In this way. the user can 
easily see a change in the status of the device con- 
nected to the transmission line 1. 
[0183] The present embodiment described above 
comprises a controller having a user interface and a 
device having a function list indicating functions thereof, 
in which the device transmits the function list through a 
transmission line to the controller, and the controller 
notifies the information about the device to a user with 
using the function list and controls the device with the 
function list according to an instruction from the user, 
thereby making it possible to realize a user-friendly 
operational environment in a simple configuration and 
readily adapt to a device having a new function not con- 
ceivable at present. Moreover, the controller has the 
function lists of all devices which can be used, to speed- 
ily display the information about each device. 
101841 Besides, a device information layer indicating 
the information about the device and a function informa- 
tion layer indicating the functions of the device are pro- 
vided in the function list which respectively optimizes 
operational environments for each device and function 
of the device. Consequently, a user-friendly operational 
environment can be realized. 

[01851 A device GUI layer and a function GUI layer 
describing user interface information about Ihe device 
shown in the device information layer and function infor- 
mation layer are further included, which making it possi- 
ble to construct a flexfcle operational environment for 
each device or function. 

[01 86J Moreover, the function information layer is clas- 
sified for each function of the device to have one or a 
plurality of corrtmands for each function. This makes it 
possible to customize a user interface for each function, 
unify display of functions of ail devices when displayed 
on the controller, and provide an easy-to-understand 
operational environment for a new function not conceiv- 
able at present 

[01 87] Besides, an identifier is provided for each func- 
tion descried in the function information layer, thereby 
facilitating identification and retrieval of a function when 
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managing or retrieving the function fist with the-controt- 
ler. 

10188] The device GUI layer or function GUI layer is 
classified according to the operation of the user and the 
status of the device, which makes it possible to easily 5 
construct a user-friendly and easy-to-understand user 
interface. 

[0189J Moreover, the function Hst has screen display 
data representing a device or function, thereby provid- 
ing optimal screen display as for each device and tunc- >c 
tion and providing a user-friendly operational screen 
display 

[0190] The device GUI layer or function GUI layer has 
screen display data for each category Optimal screen 
display thus can be provided as tor each category in is 
each hierarchy, to deepen user s intuitive understanding 
and provide an operational screen display capable of 
supporting user s operation. 

10191] The function list includes screen display data 
which is data of a plurality of still pictures, and the con- 20 
trailer sequentially displays the plurality of still picture 
data while switching the data every given time period. 
Thus, quasi -mot ion pictures can be displayed on the 
screen without an execution code operating in the con- 
troller, and more easy-to-understand operational envi- 25 
ronment can be provided independently of the structure 
of the controller (a type of the CPU and the like). 
[0192] Furthermore, the function list further includes 
screen display data consisting of data of a plurality of 
still pictures and a flag indicating a display method of 30 
the plurality of still picture data. This enables display of 
quasi-motion pictures, still pictures and the like suitable 
for each scene and specification of a reproducing speed 
of the quasi-motion picture. As a result, the intention of 
a GUI's creator becomes clearer to the user. 35 
[01 93] Besides, the function hst further includes aucfio 
data, used for the user interface, such as audio data for 
a device or a function and the like, which makes it pos- 
sible to provide the user with audio information appro- 
priate for each device and function and realize a user- 40 
friendly operational environment. 
[01 94] The device GUI layer or the function GUI layer 
has audio data for each category, to provide the user 
with audio information appropriate for each category in 
each hierarchy and support/facilitate the user's under- 45 
standing. 

[0195] Furthermore, the function fist further includes 
audio data and a flag indicating a reproduction method 
of the autfio data. Thus, it is possWe to specify the 
reproduction method of the audio data in detail in addi- so 
tion to simply offering audio, and provide the user with 
optimal audio information according to the scene. 

< Second embodiment ) 

55 

[01 96] A second embodiment of the present invention 
is described below with referring to the drawings. 
[0197] FIG. 10 illustrates a function fist in a network 



control system according to the second embodiment of 
the present invention 

[0198] In FIG. 10. reference numerate 45 and 46 rep- 
resent sub-device information layer indicating informa- 
tion about a sub-device and a sub-device GUI layer 
indicating GUI information for the sub-device, respec- 
tively. Here, the same constituents as those in the first 
embodiment are assigned the same reference numerals 
and the description thereof is omitted. Note that the 
sub-device in the present description refers to each 
device in the case where a plurality of devices are con- 
tained in one piece of equipment and the plurality of 
devices are collectively referred to as a device. For 
example, in the case of the DVHS 33 shown in FIG. 3. a 
digital terrestrial wave tuner and VCR capable of record- 
ing/reproducing video are respectively referred to as 
sub-devices. 

[0199] FIG. 10 shows an example of the DVHS 33 
equipped with the digital terrestrial wave tuner (TV 
tuner). In the device information layer 41. the device 
name, the device type, the model name, the unique ID 
and the like are described as information about the 
device. In the device GUI layer 44. the still picture 
sequence for cfisplay. the audio data and the like are 
described as GUI information of the device. 
[0200] The sub-device information layer 45 is placed 
below the device information layer 41 and contains 
information about each sub^ievice (the TV tuner and 
the D-VCR in the present embodiment). Note that items 
described in the sub-device information layer 46 are a 
sub-device name denoting a name of a sub-device, a 
sub-device type expressing a type of the sub-device in a 
code, a sub-device ID for identifying the sub-device, and 
the like. The sub-device type is. for example, code data 
expressed by subunrtjype of AV/C-CTS discussed by 
the 1 394TA. The sub-device ID is obtained by assigning 
different numbers to each sub-device in one device. It is 
of course possible that different numbers are assigned 
to sub-devices of the same sub-device type as sub- 
device IDs. In this case, each sub-device is identified 
with the sub-device type and sub-device ID. 
[0201] As in the case with the device information layer 
41 and the function information layer 42, the sub-device 
information layer 45 has a sub-device GUI layer 46 in 
which GUI information of a sub-device (a stifl picture 
sequence for display, audio data and frie like) is 
described. 

[0202] The sub-device GUI layer 46 is classified 
according to the user's operation and the status of the 
device. Each category resulting from the classification 
has a GUI type expressing a type of a GUI inacode, the 
still picture display flag 52. a still picture sequence for 
display composed of one or a plurality of stiB pictures, 
the audio reproduction flag 53. audio data and the like. 
Here, the GUI type includes, tor example, "display on 
screen" used when a device is displayed on the screen 
of the controller, "selected" displayed when the device is 
selected on the screen of the controller, "in operation" 
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displayed on the screen of the controller when the 
device is in operation, "in use" used when the device is 
used by another controller, "error" displayed on the 
screen of the controller when the device does not 
accept an instruction from the controller, and the like. 
Note that rn the "displayed on screen" category of the 
GUI type, information indicating description, specifica- 
tion and operational method of the sub-device may be 
included. 

(0203] Below the sub-device information layer 45. 
placed is function information layer 42. To the function 
information layer 42. the function GUI layer 43 is added. 
The function information layer 42 and the function GUI 
layer 43 are identical with those in the first embodiment 
and the description thereof is omitted here. i 
[0204] FIG. 1 1 is a block diagram showing a function 
table which is an example of the function list in the sec- 
ond embodiment. As in the case with the function infor- 
mation entry in the first embodiment, a sub-device entry 
is disposed in the memory area of the device informa- i 
tion layer 41 . In the present embodiment, the area of the 
sub-device information layer 45 is disposed subsequent 
to the device information layer 41. fri the sub-device 
information layer 45, a sub-device GUI entry and a func- 
tion information entry are 2 
disposed. Note that each of a sub-device entry, sub- 
device name entry and the like here has an identifier for 
identifying the type of entry in the first one byte and indi- 
cates a relative address value to each directory or leaf 
in the remaining three bytes as in the case with the first 3 
embodiment The first two bits of the identifier employ 
keyjype expressed by the CSR architecture. 
[0205] Description of the operation of the present 
embodiment is omitted here since it is the same as that 
in the first ennbodiment except that a unique ID and a a 
sub-device ID are used for identifying a device in place 
of the unique ID. The sub-device ID is also used, when 
the controller controls the device, as a destination used 
when the controller transmits a command to the device. 
[0206] As described in the above, the device informa- « 
tion layer indicating information about a device, the sub- 
device information layer indicating information about a 
sub-device in said device, and the function information 
layer indicating functions of said sub-device are pro- 
vided. It is thus possible to provide an appropriate oper- 4i 
ational environment tor each sub-device in each device, 
and control each device on a sub-device basis from dif- 
ferent controllers. 

[0207] The sub-device GUI layer descrfoing user inter- 
face information of the sub-device indicated in the sub- sc 
device information layer 45 is provided, whereby a flexi- 
ble user interface can be constructed for each sub- 
device and an optimal and user-friendly operational 
environment can be realized for each sub-device. 

55 

(Third Errtxxfiment) 

[0208] Described below is a third embodiment of the 



present invention with referring to the drawings: 
[0209] FIG 1 2 is a block diagram showing a structure 
of a device in a network control system according to the 
third embodiment. 

5 [0210] In FIG. 12. a reference numeral 15 stands for 
ROM (Read Only Memory) as a non-rewritable memory 
area where a part of the function fist 8 is disposed, and 
a reference numeral 16 stands for RAM (Random 
Access Memory) as a rewritable memory area where a 

to part of the function fist 8 is disposed. Constituents iden- 
tical with those in the first embocfiment are assigned the 
same reference numerals and the description thereof is 
omitted. 

[0211] In the present embodiment, the function list 8 

i5 is disposed not only in ROM 15 but also in RAM 16. In 
RAM 16 where the function list 8 is disposed, the inside- 
of-equipment controller 9 writes information as required. 
The information to be written here is. for example, infor- 
mation indicating the contents, that is, attribute informa- 

v tion including identification information for the contents 
(hereinafter, such attrtoute information for the contents 
is simply referred to as "contents information"), more 
specifically, currently-broadcast program information 
(information about the title of the program, title screen 

s display, theme music, synopses, cast, and the like) in 
the case of the STB. and information about the contents 
recorded in a DVD disk (information about the title, title 
screen, theme music, synopses, cast, and the like) in 
the case of the DVD. Additionally, identification informa- 

0 tion of the controller using the device, status information 
of the equipment may be written in RAM 16. 
[0212] FIG. 13 illustrates an exemplary function list in 
the present embodiment. The example for the STB is 
described. It should be noted that the device GUI layer 

5 44 is omitted here. 

[0213] In FIG. 13. in RAM 16 in the function list 8, 
every time the contents broadcast on each channel of 
the STB change, the inside- of -equipment controller 9 
rewrites the corresponding part in the function informa- 

-> tion layer 42 and the function GUI layer 43. For example, 
in the case where the broadcast contents on a channel 
101 (lOlch) change, the inskJe-of -equipment controller 
9 rewrites the sttP picture sequence for display and 
audio data for "displayed on screen" in the function GUI 

» layer 43. ff the still picture display flag 52 and audio 
reproduction flag 53 must be rewritten to change the still 
picture sequence for display and audio data, the still pic- 
ture display flag 52 and audio reproduction flag 53 are 
rewritten at the same time. Moreover, in the case where 

» a command controlling the device is changed due to the 
change in the broadcast contents, for example, the cor- 
responding function information layer 42 is rewritten. 
When the broadcast on the channel ends, the function 
information layer 42 and the function GUI layer 43 are 
deleted. 

[0214] Note that a table state Hag is added to the func- 
tion information layer 42 in the present emboc&rnent 
[021 5] FIG. 14 is a block diagram showing an exem- 
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plary table state Hag in the present embodiment, pref- 
erence numeral 54 represents the tabfe state flag where 
the first one byte (13H in FIG. 14) is an identifier indicat- 
ing the table state flag 54. and the next four bits TT 
express in a code whether the information correspond- < 
ing to each of the function in the function information 
layer 42 is disposed in a non-rewritable area or a rewri- 
table area. The remaining twenty bits "W" represents 
version information and is a figure to which one is added 
each time the information in RAM 16 where the function i 
list 8 is disposed is rewritten. It is obvious that in the 
case where the information in RAM 16 might be fre- 
quently rewritten, the flag may be extended to have 
more bits for the version information. 
[0216] FIG. t5 is a block cfiagram showing an exem- j 
plary function list in the third embodiment. FIG. 15 
shows the function information layer 42 and function 
GUI layer 43 which have areas as shown in FIG. 15 for 
each function. The items in the area of the table state 
flag 54 are set depending on the areas where the func- 2 
tion information layer 42 and function GUI layer 43 are 
disposed 

[0217] Each entry and the like in the areas has an 
identifier for identifying the type of entry in the first one 
byte as in the case with the first embodiment, and indi- 2 
cates a : relative address value to each directory or leaf 
in the remaining three bytes. Note that key_type 
expressed in the CSR architecture is used here in the 
first two bits of the identifier. 

[0218] Described next is operation of the present a 
embodiment. 

f0219] . First, when a device is connected to the trans- 
missionjne 1 . a controller on the transmission line 1 
recognizes the new device, for example, by means of 
bus reset and the like in the case of the 1 394 bus. then a 
reads the function list 8 from the new device with using 
the function fist managing portion 12. and copies and 
registers the information of the function list 8 to/in the 
function database 13 of the controller. The screen dis- 
play/equipment function selection portion 14 refers to 4i 
the function fist 8 in the function database 13 through 
the function fist managing portion 12. When the list of 
devices connected to the controller is displayed accord- 
ing to the user's manipulation of a remote controller and 
the like, the screen splay/equipment function selection 4t 
portion 14. white using the function list managing por- 
tion 12. reads the device name and device type in the 
device information layer 41 . the still picture sequence for 
display in the device GUI layer 44. and the like from the 
function lists 8 of all devices registered in the function sc 
list managing portion 12, and displays the same on the 
screen. 

[0220] Next, when the user selects, for example, the 
STB whose unique ID is XXXX by means of the pointing 
function of the remote controller (e.g. a cross key) and 55 
the like, the screen display/equipment function selection 
portion 14 reads the stifl picture sequence for display 
and the like tor the selected occasion in the device GUI 



layer 44. and displays the same on the screen. After 
that, the screen display/equipment function selection 
portion 14. while using the function list managing por- 
tion 1 2. reads the still picture sequence for display in the 
function GUI layer 43 for each function described in the 
function information layer 42 from the function list 8 of 
the device, and display the same on the screen based 
on an instruction from the still picture display flag 52. In 
this way. the graphics representing the functions and the 
contents information of the device is displayed on the 
screen. The screen display/equipment function selec- 
tion portion 14 grasps the possibility that the each func- 
tion is rewritten and version information from the table 
state flag 54 through the function list managing portion 
12. In the case there is possibility that a function is 
rewritten, the function list managing portion 12 monitors 
the corresponding function in the function list 8 of the 
device at periodic time intervals. While the function list 8 
of the device is monitored here at periodic time inter- 
vals, the function list 8 of the device may be checked 
when a cursor is located on or moved onto graphics rep- 
resenting the function which might be rewritten. Thus, 
the traffic on the transmission line 1 can be decreased, 
and update information can be provided in accordance 
with the user's intention. 

[0221] Furthermore, for example, when the user 
moves the cursor onto graphics representing the con- 
tents information of the 101 ch by means of the pointing 
function and the like of the remote controller, the screen 
display/equipment function selection portion 14, while 
using the function list managing portion 12 fetches 
audio data again in the "displayed on screen" category 
in the function GUI layer 43 whose function information 
layer is for 101ch. and reproduces the audio data based 
on an instruction of the audio reproduction flag 53. The 
audio data may be, for example, audio explaining the 
function, some melody, or audio indicating a selection 
method. In the case where the user moves the cursor 
onto graphics representing the reproduction function of 
the device, the screen display/equipment function 
selection portion 14 reproduces audio data not immedi- 
ately but only when the cursor has still been located in 
the present position even after a lapse of time (e.g. 
almost a second) required to predict that the user's 
intention is tfrected to the function. 
[0222] The operation in the case that the user selects 
graphics representing each function, for example, the 
contents information of the 101ch and that the device 
does not accept the command transmitted by the con- 
troller for some reason is the same as that in the fist 
embodiment, and therefore the description thereof is 
omitted. 

[0223] When the information in the device that might 
be rewritten (eg. the contents information) changes, the 
device rewrites a Directory indicating the corresponding 
function in the function i n formation layer 42 in its func- 
tion list 8. In the controller, the function list managing 
portion 12 monitors at periafic time intervals a function 
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that might be rewritten in RAM 1 6 in the function list 8 in 
the device. When the corresponding function in RAM 1 6 
in the function list 8 in the device is rewritten, the func- 
tion list managing portion 12 fetches new data of the 
corresponding function via transmission line 1. then $ 
rewrites the corresponcfing function in the function list 8 
of the device in the function database 13. and notifies 
the screen c5splay/equipment function selection portion 
14 that the corresponding function is rewritten In 
response to this, the screen display/equipment function w 
selection portion 14 fetches screen display data and the 
like of the corresponding function from the function list 8 . 
in the function database 13. and displays the same on 
the screen or reproduces audio data. When the informa- 
tion that might be rewritten in the device changes, the 15 
controller monitors the change and fetches data here, 
however, it is posstole that the device transmits the infor- 
mation to the controller. In this case, the necessity to 
fetch the information is obviated, whereby the traffic on 
the transmission Rne 1 and the load on the controller 20 
can be reduced and the configuration can be simplified. 
Particularly, the contents information that might be fre- 
quently rewritten is transmitted to the controller without 
a request from the controller, thereby significantly 
reducing the traffic on the transmission line and the load 25 
on the controller. 

[0224J The status of a device is described in RAM 1 6 
in the function list 8. The controller can thus grasp the 
entire status of the device at a time when monitoring the 
status of the device, thereby making it posstole to 30 
decrease the traffic on the transmission line 1 and facil- 
itate the processing in the controller. Moreover, the 
device does not have to respond to each inquiry about 
its status. As a result, the processing of the device can 
be simplified and the load on the device can be 35 
reduced. 

[0225] As described above, according to the present 
embodiment, a non-rewritable area and a rewritable 
area are included in the function list in the device, 
whereby information thai ceaselessly changes as weO 40 
as information fixed in the device can be provided to the 
controller in a simple configuration, and changing infor- 
mation can be speedily provided to the user. 
[0226] When the contents in the rewritable area 
changes, the device notifies the controller that the con- 45 
tents in said rewritable area change. This obviates the 
necessity for the controller to monitor the information 
about the device, and reduces the traffic on the trans- 
mission fine and the toad on the controller. 
[0227] to the rewritable area in the function list in the so 
device, said device stores the information about the cur- 
rently-reproductole contents, whereby information 
changing with time, especially the contents information 
to be a basis of user's operation of the equipment can 
be readily and speedily fetched. 55 
[0228] Furthermore, when contents reproducible by 
the device change, the device transmits to the controller 
the information about the contents that becomes newly 



reproductole. This obviates the necessity for the control- 
ler to monitor the contents information and fetch the 
contents information that might frequently change. As a 
result the load on the corrtroaer can be reduced, the 
configuration can be simplified. 
[0229] In the rewritable area in the function list in the 
device, the device stores a response to a request from 
the controller. Therefore, when there are a lot of 
responses, the device has only to write the responses in 
the rewritable area in the f unction list That is. a job such 
as cSviding and transmitting the responses can be omit- 
ted, and therefore the load on the device can be 
reduced. 

[0230] In the rewritable area in the function list in the 
device, the status information of the device is stored. 
This obviates the necessity for the controller to issue 
various commands to confirm the status of the device. 
Therefore, entire information about the controller can be 
fetched at a time. Consequently, the load on the control- 
ler can be reduced and the traffic on the transmission 
fine can be decreased. 

[0231 ] Furthermore, a flag indicating whether a direc- 
tory in the function fist in the device is disposed in the 
rewritable area or non-rewritable area is provided, 
thereby allowing the controller to readily confirm for 
each directory whether the information might be rewrit- 
ten or not. Thus, the controller has only to check the 
information that might be rewritten, whereby the load on 
the controller can be reduced. 

[0232] While the still picture sequence for display and 
audio data are used in the device GUI layer, the function 
GUI layer or the sur>device GUI layer in the above 
embodiments, screen display and audio output of the 
controller may be realized by an execution code execut- 
able in the controller and a bytecode assuming a virtual 
machine. In this case, although constraints are added to 
the structure of the controller (a type of CPU, support for 
the virtual machine and the like), the same effect can be 
obtained. 

< Others > 

[0233] In each embodiments described in the above, 
the equipment connected to the transmission fine 1 han- 
dles at least one of video, audio or information. How- 
ever, equipment which does not directJy relate to any of 
video, audio or information, for example, an air condi- 
tioner and the l&e may be connected to the transmis- 
sion line 1 as equipment (device) to be controlled by the 
controller. The present invention can be applied to a 
network control system in which such equipment is 
interconnected. 

INDUSTRIAL APPLICABILITY 

[0234] The present invention is appfied to a network 
control system for operating over a network equipment 
interconnected on the network, more specifically to an 
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equipment control system provkfing on a screen.- a 
graphical user interface (GUI) for supporting user's 
operation of equipment by means c4 graphics, charac- 
ters and the like. The present invention rs suitable for. for 
example, a network control system in which a plurality of 5 
AV equipment are interconnected by a transmission line 
such as a serial bus of the IEEE standard 1394 and 
equipment having the GUI controls other equipment 
through the transmission fine. 

10 

Claims 

1. A network control system in which a plurality of 
equipment are connected through a transmission 
fine, and first equipment controls second equipment is 
through said transmission line, wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 20 
said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device has function information indicating 25 
functions of said device itself, and 
^said controller acquires said function informa- 
tion from said device through said transmission 
line, and controls said device through said 
transmission line through the use of said func- 30 
tion information according to a user's operation 
performed by means of said user interface. 
.« i 

2. Second equipment, connected to first equipment 
including a controller through a transmission line, ss 
including a device to be controlled by said controller 
through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 40 
mation, and 
wherein said device 

has function information indicating functions of 
said device, 

sends said function information to said trans- 45 
mission line in response to a request from said 
controller, and 

operates in accordance with control performed 
by said controller on a basis of said function 
information to realize the functions of said so 
device. 

3. First equipment connected to second equipment 
through a transmission line, including a controller 
controlling a device included in said second equip- ss 
ment through said transmission line. 

at least one of said first and second equipment 



handBng at least one of video, audio, and infor- 
mation, and 
wherein said controller 
comprises a user interface, 
acquires function information indicating func- 
tions of said device from said device through 
said transmission line, and 
controls said device through said transmission 
line through the use of said function information 
according to a user's operation performed by 
means of said user interface. 

4. The network control system according to claim 1. 
wherein 

said function information has a layer structure, 
and includes a device information layer com- 
posed of attrtoute information including identifi- 
cation information of said device, and function 
information layer indicating the functions of 
said device. 

5. The network control system according to daim 1. 
wherein 

said device includes a plurality of sub-devices, 
and 

said function information has a layer structure, 
and includes a device information layer com- 
posed of attribute information including identifi- 
cation information of said device, a sub-device 
information layer composed of attribute infor- 
mation including identification information of 
said sub-devices, and function information 
layer indicating the functions of said sub- 
device. 

6. The network control system according to claim 1. 
wherein said function information includes user 
interface information. 

7. The network control system according to claims 4 
or 5, wherein said function information includes a 
device GUI layer composed of user interface infor- 
mation of the device identified with the attrtoute 
information in said device information layer. 

8. The network control system according to claims 4 
or 5. wherein said function information includes a 
function GUI layer composed of user interface infor- 
mation of the functions in said function information 
layer. 

9. The network control system according to daim 5. 
wherein said function information has a sub-<Jevice 
GUI layer composed of user interlace information of 
sub-devices identified with the attribute information 
in said sub-device information layer. 
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10. The network control system according to claims 4 
or 5 wherein an identifier is provided for each of the 
functions in said function information layer. 

11. The network control system as in any one of claims s 
7. 8 and 9. wherein information in said device GUI 
layer, said function GUI layer or said sub-device 
GUI layer is classified according to user's operation 
and a status of said device. 

io 

12. The network control system according to claim 1, 
wherein 

said function information includes a control 
code corresponding to each of the functions is 
which said device has. and 
when said controller transmits the control code 
included in said function information to said 
device through said transmission line, said 
device operates in accordance with said con- 20 
trol code to realize a function corresponding to 
said control code. 

13. The equipment according to claim 2. wherein 

25 

said function information includes a control 
code corresponding to each of the functions of 
said device, and 

said device sends said function information to 
said transmission line in response to the prede- 30 
termined request from said controller, and 
operates in accordance with the control code 
received from said controller, to realize a func- 
tion corresponding to said control code. 

35 

14. The equipment according to claim 3. wherein said 
controller acquires said function information includ- 
ing a control code corresponding to each of the 
functions of said device from said device through 
said transmission line, and sends the control code <o 
in said function information to said device through 
said transmission line according to the user's oper- 
ation performed by means of said user interface, to 
control said device. 

45 

15. The network control system according to claim 1. 
wherein 

said function information includes display data 
representing each of the functions of said so 
device, and 

said controller includes display means for Dis- 
playing the functions of said device through the 
use of said display data. 

55 

16. The equipment according to daim 2, wherein 

said function information includes display data 



representing each of the functions of said 
device, and 

said device sends said function information to 
said transmission line in response to the prede- 
termined request from said controller, and 
operates in accordance with the control per- 
formed by said controller on the basis of said 
function information, to realize the functions of 
said device. 

17. The equipment according to claim 3. wherein 

said controller 

comprises display means as said user inter- 
face, and 

acquires said function information including 
display data representing each of the functions 
of said device from said device through said 
transmission Tine, and displays each of the 
functions of said device with said display 
means through the use of said display data, to 
control said device through said transmission 
line through the use of said function information 
according to the user s operation performed by 
means of said user interface. 

18. The network control system according to claim t5. 
wherein 

said function information includes a control 
code corresponding to each of the display data, 
said controller displays each of the functions of 
said device with said display means through 
the use of the display data included in said 
function information, and transmits the control 
code corresponding to said display data 
through said transmission line to said device 
according to the user's operation performed by 
means of said user interface for said display 
data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line, to realize a 
function indicated by said display data corre- 
sponding to said control code. 

19. The equipment according to claim 16. wherein 

said function information includes a control 
code corresponding to each of said display 
data, and 

said device sends said function information to 
said transmission fine in response to the prede- 
termined request from said controller, and 
operates in accordance with the control code 
received from said controller, to realize a func- 
tion indicated by said display data correspond- 
ing to said control code. 
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20. The equipment according to daim 1 7, wherein said 
controller acquires said function information includ- 
ing the display data representing each of the func- 
tions of said device and a control code 
corresponding to each of the display data, displays 5 
each of the functions of said device through the use 
of said display data with said display means, and 
transmits the control code corresponding to said 
display data through said transmission line accord- 
ing to the user's operation performed by means of w 
said user interlace for said display data, to control 
said device. 

21. The network control system according to claim 11, 
wherein 15 

said device GUI layer, said function GUI layer, 
or said sub-device GUI layer includes display 
data for each of the classified categories, and 
said controller comprises display means for 20 
displaying the user interface of said device, 
said function, or said sub-device for each of the 
categories through the use of said display data. 

22. The network control system according to claim 1, 25 
wherein 

said function information includes audio data 
for the user interface, and 

said controller includes audio reproducing 30 
means for reproducing audio through the use 
of said autfio data. 

23. The network control system according to claim 11. 
wherein 35 

said device GUI layer, said function GUI layer, 
or said sub-device GUI layer includes audio 
data for each of the classified categories, and 
said controller comprises audio reproducing 40 
means for reproducing audio as the user inter- 
face of said device, said function, or said sub- 
device for each of the categories through the 
use of said audio data. 

45 

24. The network control system according to claim 1, 
wherein 

said function information includes a control 
code corresponding to each of the functions of so 
said device, 
said device comprises: 

device communication means for communicat- 
ing with said controller through said transmis 
sion tine; and 

first control means for sending said function 
information to said trartsrrtission fine in 
response to a predetermined request received 



from said controller with said device communi- 
cation means, and making said device operate 
in accordance with the control code received 
from said controller with said device communi- 
cation means, and 
said controller comprises: 
controller communication means for communi- 
cating with said device through said transmis- 
sion line; and 

second control means for acquiring said func- 
tion information from said device by transmit- 
ting the predetermined request to said device 
with said controller communication means, and 
for controlling said device by transmitting the 
control code in said function information with 
said controller communication means accord- 
ing to the user s operation performed by means 
of said user interface. 

25. The equipment according to claim 2. wherein 
said device comprises: 

storage means containing therein said function 
information including a control code corre- 
sponding to each of the functions of said 
device; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, and 
making said device operate in accordance with 
the control code received from said controller 
with said communication means. 

26. The equipment according to claim 3. wherein 

said controller comprises: 
communication means for cornrnunicating with 
said device through said transmission line; and 
control means for acquiring from said device 
said function information including a control 
code corresponding to each of the functions of 
said device by transmitting a predetermined 
request to said device with said communication 
means, and for controlling said device by trans- 
mitting the control code in said function infor- 
mation with said communication means 
according to the user s operation performed by 
means of said user interface. 

27. The network control system according to claim 1. 
55 wherein 

said function information includes display data 
representing each of the functions of said 
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device. 

said device comprises: 

device communication means for communicat- 
rng with said controDer through said transmis- 
sion tine; and 5 
first control means for sending said function 
information to said transmission tine with said 
device communication means in response to a 
predetermined request received from said con- 
troller, and making said device operate in w 
accordance with control information received 
from said controller with said device communi- 
cation means, and 
sad controller comprises: 

display means for said user interface; is 
controller communication means for communi- 
cating with said device through said transmis- 
sion line; and 

second control means for acquiring said func- 
tion information from said device by transmit- 20 
ting the predetermined request to said device 
with said controller communication means, for 
displaying each of the functions of said device 
with said display means through the use of the 
display data included in said function informa- 25 
tion. and for controlling said device by transmit- 
ting the control information on the basis of said 
function information with said controller com- 
munication means according to the user's 
operation by means of said user interface. 30 

28. The equipment according to claim 2. wherein 



to said device with said communication means, 
for displaying each of the functions of said 
device with said display means through the use 
of said cfisplay data, and for controlling said 
device by transmitting control information on 
the basis of said function information with said 
communication means according to the user's 
operation performed by means of said user 
interface. 

30. The network control system according to claim 27. 
wherein 

said function information includes a control 
code corresponding to each of the display data, 
the first control means in said device makes 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to realize a 
function represented by said display data cor- 
responding to said control code, and 
the second control means in said controller dis- 
plays each of the functions of said device with 
said display means through the use of the dis- 
play data included in said function information 
acquired from said device with said controller 
communication means, and transmits the con- 
trol code corresponding to said display data 
with said controller communication means 
according to the user's operation performed by 
means of said user interface for said display 
data. 



said device comprises: 

storage means containing therein said function 35 
information including display data representing 
each of the functions of said device; 
communication means for communicating with 
said controller through said transmission fine; 
and 40 
control means for sending said function infor- 
mation to said transmission line in response to 
a predetermined request received from said 
controller with said communication means, and 
making said device operate in accordance with 45 
control information received from said control- 
ler with said communication means. 



29. The equipment according to claim 3. wherein 

50 

sad controller comprises: 
dsptey means tor sad user interface; 
communication means tor comrnmfoating with 
sad device through sad transmission line; and 
control means tor acquiring from sad device ss 
sad function information including display data 
representing each of the functions of said 
device by transmitting a predetermined request 



31. The network control system according to claim 30. 
wherein the second control means in sad control- 
ler, when any one of the display data is selected by 
the user based on display provided by sad display 
means, transmits the control code corresponding to 
the selected display data with said controller com- 
munication means. 

32. The network control system according to claim 30, 
wherein sad function information includes one or a 
plurality of control codes corresponding to each of 
the display data. 

33. The network control system according to claim 27. 
wherein 

sad display data is data of a plurality of stffl pic- 
tures, and 

sad display means in sad controller sequen- 
tially displays sad plurality of stiB pictures 
through the use of sad display data while 
switching sad still pictures at a substantially 
constant time interval. 

34. The network control system according to daim 27. 
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wherein 

said display data is data of a plurality of still pic- 
tures. 

said function information includes display con- s 
trol information indicating a display method of 
said plurality of still pictures, and 
said display means in said controller displays 
said plurality of still pictures through the use of 
said display data in accordance with said dis- w 
play control information. 

35. The equipment according to claim 28. wherein 

said function information includes a control is 
code corresponding to each of the display data, 
and 

said control means makes said device operate 
in accordance with the control code received 
from said controller with said communication 20 
means, to reaBze a function represented by 
said display data corresponding to said control 
code. 

36. The equipment according to daim 29. wherein said 25 
control means acquires with said communication 
means said function information including the dis- 
play data representing each of the functions of said 
device and a control code corresponding to each of 
the display data, displays each of the functions of 30 
said device with said display means through the 
use of said display data; and transmits the control 
code corresponding to said display data with said 
communication means according to the users 
operation performed by means of said user inter- 35 
face, for said display data, to control said device. 

37. The network control system according to claim 1, 
wherein 

40 

said function information includes audio data 
for the user interface, 
said device comprises: 

device communication means for cornmunicat- 
ing with said controller through said transmis- 45 
sion line: and 

first control means for sending said function 
information to said transmission Bne in 
response to a predetermined request received 
from said controller with said device commurti- so 
cation means, and making said device operate 
in accordance with control information received 
from said controller with said device communi- 
cation means, and 

said controller comprises: 55 
aufio reproducing means for reproducing 
audio from audio data; 

controller communication means for communi- 



cating with said device through said transmis- 
sion line; and 

second control means for acquiring said func- 
tion information from said device by transmit- 
ting the predetermined request to said device 
with said controller communication means, for 
reproducing audio with said audio reproducing 
means through the use of the audio data 
included in said function information, and for 
controlling said device by transmitting control 
information on the basis of said function infor- 
mation with said controller communication 
means according to the user's operation per- 
formed by means of said user interface. 

3a The equipment according to claim 2, wherein 

said device comprises: 

storage means containing therein said function 
information including audio data for a user 
interface; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means tor sending said function infor- 
mation to said transmission fine in response to 
the predetermined request received from said 
controller with said communication means, and 
making said device operate in accordance with 
control information received from said control- 
ler with said communication means. 

39. The equipment according to claim 3. wherein 

said controller comprises: 

audio reproducing means for reproducing 

audio from audio data; 

communication means for communicating with 
said device through said transmission line; and 
control means for acquiring from said device 
said function information including the audio 
data for the user interface by transmitting a pre- 
determined request to said device with said 
communication means, for reproducing audio 
with said audio reproducing means through the 
use of said audio data included in said function 
information, and for controlling said device by 
transmitting control information on the basis of 
said function information with said comrrturuca- 
Hon means according to the user's operation 
performed by means of said user interface. 

40. The network control system according to claim 37. 
wherein 

said function information includes the audio 
data for the user interface and reproduction 
control information indicating a reproduction 
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method of said audio data, and 
said audio reproducing means in said controller 
reproduces audio in accordance with said 
reproduction control information through the 
use of said audio date. 5 

41. The network control system according to claim i, 
wherein said device, when there occurs a change in 
said function information, notifies said controller 
through said transmission fine that said change io 
occurs. 

42. The equipment according to claim 2, wherein 

said device comprises: 15 
storage means containing therein said function 
information; 

communication means for communicating with 
said controller through said transmission line: 
and 20 
control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, 
notifies, when there occurs a change in said 25 
function information, said controller with said 
communication means that said change 
occurs, and making said device operate in 
accordance with control information received 
from said controller with said communication 30 
means. 

43. The equipment according to claim 3. wherein 

said controller comprises: ' 35 
communication means for communicating with 
said device through said transmission line; and 
control means for acquiring said function infor- 
mation from said device by transmitting a pre- 
determined request to said device with said <o 
communication means, and for controlling said 
device by receiving, when a notification that 
said function information changes is transmit- 
ted from said device, said notification with said 
communication means, and transmitting con- 4s 
trol information on the basis of said function 
information with said communication means 
accorcSng to the user's operation performed by 
means of said user interface. 

so 

44. The network control system according to claim 1 , 
wherein said device transmits, when there occurs a 
change in said function information, the changed 
information to said controller through said transmis- 
sion line. 55 

45. The equipment according to claim 2, wherein 



said device comprises: 

storage means containing therein said function 
information; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, 
transmitting, when there occurs a change in 
said function information, the changed informa- 
tion to said controBer with said communication 
means, and making said device operate in 
accordance with control information received 
from said controller with said communication 
means. 

46. The equipment according to claim 3, wherein 

said controller comprises: 
communication means for communicating with 
said device through said transmission line; and 
control means for acquiring said function infor- 
mation from said device by transmitting a pre- 
determined request to said device with said 
communication means, and for controlling said 
device by receiving, when changed information 
in said function information is transmitted from 
said device, said changed information to 
update said function information, and transmit- 
ting control information on the basis of said 
function information with said communication 
means according to the user's operation per- 
formed by means of said user interface. 

47. The network control system according to claim 1. 
wherein said device comprises storage means that 
has a non-rewritable area and rewritable area and 
contains therein said function information in said 
non-rewritable area and rewritable area. 

48. The equipment according to claim 2. wherein 

said device comprises: 

storage means that has a non-rewritable area 
and rewritable area and contains therein said 
function information in sard non-rewritable area 
and rewritable area; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending sard function infor- 
mation to said transmission line with said com- 
munication means in response to the 
predetermined request received from said con- 
troller, and making said device operate in 
accordance with control information received 
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59 

from said controller with said communication 
means. 

49. The network control system according to claim 47. 
wherein said device notifies, when information 5 
included in said function information and stored in 
said rewritable area changes, said controller that 
said information changes. 



device with said communication means, for dis- 
playing said information indicating the contents 
with said display means, and for controlling 
said device by transmitting control information 
on the basis of said function information with 
said communication means according to the 
user's operation performed by means of said 
user interface. 



50. The network control system according to claim 47. 
wherein said storage means in said device stores a 
response to a request from said controller in said 
rewritable area among the area where said function 
information is stored. 

51. The network control system according to daim 47, 
wherein said storage means in said device stores 
status information of said device in said rewritable 
area among the area where said function informa- 
tion is stored. 

52. The network control system according to claim 47. 
wherein said storage means in said device stores a 
flag indicating whether elements forming said func- 
tion information are stored in said rewritable area or 2S 
in said non-rewritaWe area. 



56. The network control system according to daim 53. 
wherein said device notifies, when the contents 
reproducible by said device changes, said control- 
ler through said transmission line that new contents 
becomes reproducfole. 

57. The network control system according to daim 53, 
wherein 

said device transmits, when contents reproduc- 
ible by said device change, information indicat- 
ing the contents which becomes newly 
reproducible to said controller through said 
transmission line. 

58. The network control system according to daim 53. 
wherein 



15 



53. The network control system according to claim 1, 
wherein said function information includes informa- 
tion indicating contents reprodudble by said device. 30 

54. The equipment according to daim 2. wherein 

said device comprises: 

storage means containing therein said function 35 
information inducing information indicating 
contents reproductole by said device; 
communication means for communicating with 
said control! er through said transmission line; 
and 40 
control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, and 
making said device operate ri accordance with 45 
control information received from said control- 
ler with said communication means. 



said device comprises storage means having a 
rewritable area and containing therein said 
function information, and 
said storage means stores in said rewritable 
area the information indicating the contents 
reproducible by said device at present. 

Amended claims under Art. 19.1 PCT 

1. (deleted) 

2. (deleted) 

3. (deleted) 

4. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 



55. The equipment according to claim 3, wherein 

so 

said controller comprises: 
display means for said user interlace; 
corrtmunicaton means for communicating with 
said device through said transmission line; and 
control means for acquiring from said device 55 
said function information including information 
indicating contents reprodudble by said device 
by transmitting a predetermined request to said 



at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment indudes a controller hav- 
ing a user interface. 

said second equipment indudes a device to be 

controlled by said controller. 

said device has function information indicating 

functions of said device itself. 

said controller acquires said function tntorma- 
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tion from said device through said transmission 
tine, and controls said device through said 
transmission line through the use of said func- 
tion information according to a user s operation 
performed by means of said user interface, and 5 
said function information has a layer structure 
which includes a device information layer com- 
posed of attribute information including identifi- 
cation information of said device and a function 
information layer indicating the functions of io 
said device. 

5. (amended) 

A network control system in which a plurality of 
equipment are connected through a transmission 75 
line, and first equipment controls second equipment 
through said transmission line, wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 20 
mation. 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 25 
said device has a sub-device and function 
information indicating functions of said device 
itself. 

said controller acquires said function informa- 
tion from said device through said transmission 30 
fine, and controls said, device through said 
transmission line through the use of said func- 
tion information according to a user's operation 
performed by means of said user interface, and 
said function information has a layer structure 35 
which includes a device information layer com- 
posed of attribute information including identifi- 
cation information of said device, a sub-device 
information layer composed of attribute infor- 
mation including identification information of <o 
said sub-device, and a function information 
layer indicating functions of said sub-device. 

6. (deleted) 

45 

7. The network control system according to claims 
4 or 5, wherein said function information includes a 
device GUI layer composed of user interface infor- 
mation of the device identified with the attrfoute 
information in said device information layer. so 

8. The network control system according to claims 
4 or 5. wherein said function information includes a 
function GUI layer composed of user interface infor- 
mation of the functions in said function information 55 
layer. 

9. The network control system according to claim 5. 



wherein said function information has a sub-device 
GUI layer composed of user interface information of 
sub-devices identified with the attrfoute information 
in said sub-device information layer. 

10. The network control system according to claims 
4 or 5 wherein an identifier is provided for each of 
the functions in said function information layer. 

11. The network control system as in any one of 
claims 7, 8 and 9. wherein information in said 
device GUI layer, said function GUI layer or said 
sub-device GUI layer is classified according to 
user s operation and a status of said device. 

12. (amended) A network control system in which a 
piurafity of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said f irst and second equipment 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device 

has function information that indicates 
functions of said device itself and includes 
user interlace information indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface information. 

operates in accordance with the control 
code received from said controller through 
said transmission line to realize the func- 
tion indicated by said user interface infor- 
mation corresponding to said control code, 
and 

said controller 

acquires said function information from 
said device through said transmission line, 
presents each of the functions of said 
device to a user through the use of the 
user interface information included in said 
function information, and 
transmits the control code corresponding 
to said user interface to said device 
through said transmission tine in response 
to a user's operation performed by means 
of said user interface for said user interface 
information. 
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13. (amended) Second equipment connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 
led by said controller through said transmission fine, 

5 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
wherein said device 

w 

has function information that indicates 
functions of said device and includes user 
interface information indicating each of the 
functions of said device and a control code 
corresponding to each of the user interface is 
information, and 

operates in accordance with the control 
code received from said controller through 
said transmission line to realize the func- 
tion incficated by said user interlace infor- 20 
mation corresponding to said control code. 

14 (amended) First equipment, connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 25 
second equipment through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 30 
wherein said controller 
comprises a user interface, and 
acquires from said device through said trans- 
mission line function information including user 
interface information indicating each of tunc- 35 
tons of said device and a control code corre- 
sponding to each of tie user interface 
information, and controls said device by pre- 
senting to a user each of the functions of said 
device through the use of said user interface 40 
information, and transmitting the control code 
conesponding to said user interface informa- 
tion through said transmission line in response 
to a user's operation performed by means of 
said user interface for said user interface infor- 45 
mation. 

15. (deleted) 

16. (deleted) 50 

17. (deleted) 

1 8. (amended) The network control system accord- 
ing to claim 1 2. wherein 55 

said user interface information includes display 
data. 



said controller 

has display means for said user interface, 
displays the functions of said device with 
said cfisplay means through the use of said 
display data to present said functions to 
the user, and 

transmits the control code corresponding 
to said display data to said device through 
said transmission fine according to the 
user's operation performed by means of 
said user interface tor said display data, 
and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to realize the 
function indicated by said display data corre- 
sponding to said control code. 

19. (amended) The equipment according to claim 

13, wherein 

sakl user interface information includes display 
data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to realize the 
function indicated by said display data corre- 
sponding to said control code. 

20. (amended) The equipment according to claim 

14. wherein 

said user interface information includes display 
data, and 
said controller 

has display means for said user interface, 
displays the functions of said device with 
said olsplay means through the use of said 
display data to present said functions to 
the user, and 

transmits the control code corresponding 
to said display data to said device through 
said transmission fine according to the 
user's operation performed by means of 
said user interface for said display data to 
control said device. 

21 . (amended) The network control system accord- 
ing to claim 1 1 , wherein 

said device GUI layer, said function GUI layer, 
or said sub-device GUI layer includes display 
data for each of the classified categories, and 
said controder comprises display means for 
displaying the user interface of said device. 
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said function, or said sub-device tor each of the 
categories through the use of said display data. 

22. (amended) A network control system in which a 
Plurality of equipment are connected through a s 
transmission fine, and first equipment controls sec- . 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment w 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface. 

said second equipment includes a device to be is 
controlled by said controller, 
said device has function information indicating 
functions of said device itself, and said function 
information includes audio data for the user 
interface, and po 
said controller 

acquires said function information from 
said device through said transmission line, 
reproduces audio through the use of the 25 
audio data included in said function infor- 
mation, and 

controls said device through said transmis- 
sion line through the use of said function 
information according to a user s operation so 
performed by means of said user interface. 

23. (amended) The network control system accord- 
ing to claim 1 1 , wherein 

35 

said device GUI layer, said function GUI layer, 
or said sub-device GUI layer includes audio 
data for each of the classified categories, and 
said controller comprises audio reproducing 
means for reproducing audio for the user inter- <o 
face of said device, said function, or said sub- 
device for each of the categories through the 
use of said audio data. 

24. (amended) A network control system in which a <s 
plurality of equipment are connected through a 
transmission fine, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

so 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface. 55 
said second equipment includes a device to be 
controlled by said controller, 
said device 



has function information that indicates 
functions of said device itself and includes 
user interface information indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface information, and 
comprises device communication means 
for communicating with said controller 
through said transmission line, and 

first control means for sending said function 
information to said transmission line in 
response to a predetermined request received 
from said controller with said device communi- 
cation means, and making said device operate 
in accordance with the control code received 
from said controller with said device communi- 
cation means to realize the function indicated 
by said user interface corresponding to said 
control code, and 
said controller comprises 

controller communication means for com- 
municating with said device through said 
transmission line, and 
second control means for acquiring said 
function information from said device by 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for presenting to a user 
each of the functions of said device 
through the use of the user interface infor- 
mation included in said function informa- 
tion, and for controlling said device by 
transmitting the control code correspond- 
ing to said user interface information with 
said controller communication means 
according to a user's operation performed 
by means of said user interface. 

25. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission fine, including a device to be control- 
led by said controller through said transmission line. 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
wherein said device 

has function information that indicates 
functions of said device ttseH and includes 
user interface information indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface information, and 
comprises communication means for com- 
municating with said controller through 
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said transmission line, and * 
control means for sending said function 
information to said transmission fine in 
response to a predetermined request 
received from said controner with said s 
communication means and making said 
device operate in accordance with the con- 
trol code received from said controller with 
said cornmunication means to realize the 
function indicated by said user interface 10 
information corresponding to said control 
code. 

26. (amended) First equipment connected to sec- 
ond equipment through a transmission fine, inctud- is 
ing a controller controlling a device included in said 
second equipment through said transmission line. 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 20 
mation, and 

wherein said controller comprises: 
a user interface; 

communication means for communicating with 
said device through said transmission line; and 25 
control means for acquiring with said communi- 
cation means function information including 
user interface information indicating each of 
the functions of said device and a control code 
corresponding to each of the user interface 30 
information by transmitting a predetermined 
request to said device with said communication 
means, for presenting each of the functions of 
said device to a user through the use of the 
user interface information included in said tunc- 35 
tion information, and for controlling said device 
by transmitting the control code in said function 
information with said cornmunication means 
according to a user's operation performed by 
means of said user interface. 40 

27. (deleted) 

28. (deleted) 

4$ 

29. (deleted) 

30. (amended) The network control system accord- 
ing to claim 24, wherein 

50 

said user interface information includes display 
data, 

said controller has display means for said user 
interface, 

the second control means in said controller dis- 55 
plays the functions of said device with said dis- 
play means through the use of the display data 
included in said function information acquired 



from said device with said controller communi- 
cation means to present said functions to the 
user, and transmits the control code corre- 
sponding to said display data with said control- 
ler communication means according to the 
user's operation performed by means of said 
user interface for said display data, and 
the first control means in said device makes 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to provide 
the function represented by said display data 
corresponding to said control code. 

31. The network control system according to claim 
30, wherein the second control means in said con- 
troller, when any one of the display data is selected 
by the user based on display provided by said dis- 
play means, transmits the control code correspond- 
ing to the selected display data with said controller 
communication means. 

32. The network control system accorcSng to daim 
30. wherein said function information includes one 
or a plurality of control codes corresponding to each 
of the display data. 

33. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equioment through said transmission line, 
wherein 

at least one of said f irst and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface. 

said second equipment includes a device to be 
controlled by said controner, 
said device comprises: 

storage means containing therein function 
information that indicates functions of said 
device itself and includes data of a plurality 
of still pictures as display data represent- 
ing functions of said device; 
device communication means for commu- 
nicating with said controller through said 
transmission fine; and 
first control means for sending said func- 
tion information to said transmission line in 
response to a predetermined request 
received from said controller with said 
device comrnunication means, and making 
said device operate in accordance with 
control information received from said con- 
troller with said device communication 
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means, 

said controller comprises: 

display means far said user interlace; 5 
controller communication means for com- 
municating with said device through said 
transmission line; and 
second control means for acquiring said 
function information from said device by io 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for displaying the functions 
of said device with said display means 
through the use of the display data is 
included in said function information, and 
for controlling said device by transmitting 
the control information on a basis of said 
function information with said controller 
communication means accorcSng to a 20 
user's operation performed by means of 
said user interface, and 

said cSsplay means in said controller sequen- 
tially displays said plurality of still pictures 25 
through the use of said display data while 
switching the still pictures at a substantially 
constant time interval. 

34. (amended) A network control system in which a 30 
plurality of equipment are connected through a 
transmission fine, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

35 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, ao 
said second equipment includes a device to be 
controlled by said controller, 
said device comprises: 

storage means containing therein function as 
information that indicates functions of said 
device itself and includes data of a plurality 
of stifl pictures as display data represent- 
ing functions of said device and display 
control information indicating a display so 
means of said pturafity of still pictures; 
device communication means for commu- 
nicating with said controller through said 
transmission line; and 

first control means tor sending said tunc- ss 
ton information to said transmission fine in 
response to a predetermined request 
received from said controfler with said 



device communication means, and making 
said device operate in accordance with 
control information received from said con- 
troller with said device communication 
means, 

said controfler comprises: 

display means for said user interface; 
controller communication means for com- 
municating with said device through said 
transmission fine; and 
second control means for acquiring said 
function information from said device by 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for displaying the functions 
of said device with said display means 
through the use of the cfisplay data 
included in said function information, and 
for controlling said device by transmitting 
the control information on the basis of said 
function information with said controller 
communication means according to a 
user's operation performed by means of 
said user interface, and 

said display means in said controller displays 
said plurality of still pictures through the use of 
said display data in accordance with said dis- 
play control information. 

35. (amended) The equipment according to claim 

25. wherein 

said user interface information includes display 
data, and 

said control means sends said function infor- 
mation to said transmission fine in response to 
the predetermined request received from said 
controfler with said communication means, and 
makes said device operate in accordance with 
the control code received from said controfler 
with said communication means, to provide the 
function represented by said display data cor- 
responding to said control code. 

36. (amended) The equipment according to claim 

26. wherein 

said user interface information includes display 
data, 

said controller has display means for said user 
interface; and 

said control means acquires said function infor- 
mation with said communication means . and 
controls said device by displaying the functions 
of said device with said cfisplay means through 
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the use of said display data included in said 
function information to present said functions to 
the user, and transmitting the control code cor- 
responding to said display data with said com- 
munication means according to the user's 5 
operation performed by means of said user 
interlace for said display data. 

37. (amended) A network control system in which a 
plurality of equipment are connected through a w 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment is 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 20 
controlled by said controller, 
said device comprises: 

storage means containing therein function 
information that indicates functions of said 25 
device itseH and includes audio data for the 
user interface; 

device communication means for commu- 
nicating with said controller through said 
transmission line; and 30 
first control means tor sending said func- 
tion information to said transmission line in 
response to a predetermined request 
received from said controller with said 
device communication means, and making 35 
said device operate in accordance with 
control information received from said con- 
troller with said device communication 
means, and 

40 

said controller comprises: 

audio reproducing means for reproducing 
audio data; 

controller communication means for com- 45 
municating with said device through said 
transmission line; and 
second control means for acquiring said 
function information from said device by 
transmitting the predetermined request to so 
said device with said controller communi- 
cation means, for reproducing aufio with 
said audio reproducing means through the 
use of the audio data included in said func- 
tion information, and for controlling said 55 
device by transmitting the control informa- 
tion on the basis of said function informa- 
tion with said controller communication 



means accorcSng to a user's operation per- 
formed by means of said user interface. 

38. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission One, including a device to be control- 
led by said controller through said transmission line. 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 

wherein said device comprises: 

function information that indicates func- 
tions of said device and includes audio 
data for a user interface; and 
communication means for communicating 
with said controller through said transmis- 
sion line; and 

control means for sending said function 
information to said transmission line in 
response to a predetermined request 
received from said controller with said 
communication means, and making said 
device operate in accordance with control 
information received from said controller 
with said communication means. 

39. (amended) First equipment, connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 
second equipment through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 

said controller comprises: 

a user interface including audio reproducing 

means; 

communication means for communicating with 
said device through said transmission line; and 
control means for acquiring from said device 
function information that indicates functions of 
said device and includes audio data for the 
user interface by transmitting a predetermined 
r equest to said device with said communication 
means, for reproducing audio with said audio 
reproducing means through the use of said 
audio data included in said function informa- 
tion, and for controlling said device by transmit- 
ting control information on the basis of said 
function information with said communication 
means according to a user s operation per- 
formed by means of said user interface. 

40. (amended) The network control system accord- 
ing to claim 37. wherein 
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said function information includes the audio 
data for the user interface and reproduction 
control information indicating a reproduction 
method of said audio data, and 
said audio reproducing means in sad controller s 
reproduces, said audio data in accordance with 
said reproduction control information. 

41 . (amended) A network control system in which a 
Plurality of equipment are connected through a w 
transmission fine, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment is 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 20 
controlled by said controller, and 
said device 

has function information indicating func- 
tions of said device itself; and 25 
when there occurs a change in said func- 
tion information, notifies said controller 
through said transmission line that said 
change occurs. 

30 

42. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 
led by said controller through said transmission fine, 

35 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and . 
said device comprises: 

storage means containing therein function <o 
information indicating functions of said device: 
and 

communication means for communicating with 
said controller through said transmission Bne, 
and as 
when there occurs a change in said function 
information, notifies said controller with said 
communication means that said change 
occurs. 

so 

43. (amended) First equipment connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 
second equipment through said transmission line, 

55 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 



said controller comprises: 
a user interface; and 

communication means for communicating with 
said device through said transmission line; and 
when a notification that function information 
indicating functions of said device changes is 
transmitted from said device, receives said 
notification with said communication means. 

44. (amended) A network control system in which a 
pturaBty of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface. 

said second equipment includes a device to be 
controlled by said controller, and 
said device 

has function information indicating func- 
tions of said device itself, and 
when there occurs a change in said func- 
tion information, transmits the changed 
information to said controller through said 
transmission Bne. 

45. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission fine, including a device to be control- 
led by said controller through said transmission fine. 

at least one of said f irst and second equipment 
handling at least one of video, audio and infor- 
mation, and 
said device comprises: 

storage means containing therein function 
information indicating functions of said device; 
coninurrtication means for communicating with 
said controller through said transmission line; 
and 

when there occurs a change in said function 
information, transmits the changed information 
to said controller with said communication 
means. 

46. (amended) First equipment, connected to sec- 
ond equipment through a transmission fine, includ- 
ing a controller controlling a device included in said 
second equipment through said transmission line. 

at least one of said first and second equipment 
handfing at least one of video, audio, and infor- 
mation, and 



75 



EP0 939 517 A1 



76 



said controller comprises: 
a user interlace; and 

communication means for communicating with 
said device through said transmission line; and 
acquires function information indicating tunc- 5 
tions of said device by transmitting a predeter- 
mined request to said device with said 
communication means, and when changed 
information in said function information is trans- 
mitted from said device, receives said changed w 
information to update said function information 
with said communication means. 

47. (amended) A network control system in which a 
plurality of equipment are connected through a is 
transmission line, and f irst equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 20 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interlace. 

said second equipment includes a device to be 25 
controlled by said controller, and 
said device comprises storage means that has 
a non-rewritable area and rewritable area and 
contains therein function information indicating 
functions of said device itself in said non-rewri- 30 
table area and rewritable area. 

48. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 35 
led by said controller through said transmission fine. 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 40 
said device comprises: 

storage means that has a non-rewritable area 
and rewritable area and contains therein func- 
tion information indicating functions of said 
device in said non-rewritable area and rewnta- 45 
We area; and 

communication means for comrrujnicating with 
said controller through said transmission One. 

49. The network control system according to claim so 
47. wherein said device notifies, when information 
included in said function information and stored in 
said rewritable area changes, said controller that 
said information changes. 

55 

50. The network control system according to claim 
47. wherein said storage means in said device 
stores a response to a request from said controller 



in said rewritable area among the area where said 
function information is stored. 

51 . The network control system accorcfing to daim 
47. wherein said storage means in said device 
stores status information of said device in said 
rewritable area among the area where said function 
information is stored. 

52. The network control system according to claim 
47, wherein said storage means in said device 
stores a flag indicating whether elements forming 
said function information are stored in said rewrita- 
ble area or in said non-rewritable area. 

53. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation. 

said first equipment includes a controller hav- 
ing a user interface. 

said second equipment includes a device to be 
controlled by said controller, 
said device has function information that indi- 
cates functions of said device itself and 
includes information indicating contents repro- 
ducible by said device, and 
said controller acquires said function informa- 
tion from said device through transmission line, 
controls said device through said transmission 
line through the use of said function information 
according to a user s operation performed by 
means of said user interface. 

54. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission fine, including a device to be control- 
led by said controller through said transmission line. 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
said device comprises: 

storage means containing therein said function 
information that indicates functions of said 
device and includes information indicating con- 
tents reproductole by said device; 
communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
a predetermined request received from said 
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controller with said communication means, and 
making said device operate in accordance with 
control information received from said control- 
ler with said communication means. 

5 

55. (amended) First equipment connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 
second equipment through said transmission line. 

10 

at least one of said first and second equipment 
handing at least one of video, audio, and infor- 
mation, and 

satd controller comprises: 

15 

a user interface inducting display means: 
communication means for communicating 
with said device through said transmission 
line; and 

control means for acquiring from said 20 
device function information that indicates 
functions of said device and includes infor- 
mation indicating contents reproducible by 
said device by transmitting a predeter- 
mined request to said device with said 25 
communication means, for displaying said 
information indicating the contents with 
said display means, and for controlling said 
device by transmitting control information 
on the basis of said function information 30 
with said communication means according 
to a user's operation performed by means 
of said user interface. 

56. The network control system according to claim ss 
53, wherein said device notifies, when the contents 
reproductole by said device changes, said control- 
ler through sax* transmission line that new contents 
becomes reproductole. 

40 

57. The network control system according to claim 
53, wherein 

said device transmits, when contents reproduc- 
tole by said device change, information indicat- <5 
ing the contents which becomes newly 
reproducible to said controller through said 
transmission line. 

58. The network control system according to daim so 
53, wherein 

said device comprises storage means having a 
rewritable area and containing therein said 
function information, and 55 
said storage means stores in said rewritable 
area the information indicating the contents 
reproductole by said device at present. 



59. (added) The network control system according 
to claim 12, wherein 

said user interface information includes audio 
data, and 
said controller 

has audio reproducing means for said user 
interface, 

reproduces audio indicating the functions 
of said device with said audio reproducing 
means through the use of sad audio data 
to present said functions to the user, and 
transmits the control code corresponding 
to said audio data to said device through 
said transmission line according to the 
user's operation performed by means of 
said user interface for said audio data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to provide the 
function represented by said audio data cone- 
sponding to said control code. 

60. (added) The network control system according 
to claim 12, wherein said function information 
indudes one or a plurality pieces of user interface 
information for each of the control codes in said 
device. 

61. (added) The equipment accorcSng to claim 13, 
wherein 

said user interface information includes audio 
data and 

said device operates in accordance with the 
control code received from said controller 
through said transmission fine to provide the 
function represented by said audio data corre- 
sponding to said control code. 

62. (added) The equipment according to daim 13. 
wherein said function information indudes one or a 
plurality pieces of user interface information for 
each of the control codes in said device. 

63. (added) The equipment according to daim 14, 
wherein 

said user interface information includes audio 
data, and 
said controller 

has audio reproducing means for said user 
interface. 

reproduces audio indicating the functions 
of said device with said aucfio reproducing 
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80 



means through the use of said audio data 
to present said functions to the user, and 
transmits the control code corresponding 
to said audio data to said device through 
said transmission line according to the 5 
user's operation performed by means of 
said user interface for said audio data to 
control said device. 

64. (added) The equipment according to claim 14, w 
wherein said function information includes one or a 
plurality pieces of user interface information for 
each of the control codes in said device. 

65. (added) The network control system according is 
to daim 24, wherein 

said user interface information includes audio 
data, and 

20 

said controller has audio reproducing means 
for said user interface, 

the second control means in said controller 
reproduces audio indicating the functions of 25 
said device with said audio reproducing means 
through the use of the audio data included in 
. said function information acquired from said 
device with said controller communication 
means to present said functions to the user, 30 
and transmits the control code corresponding 
to said audio data with said controller commu- 
nication means according to the user's opera- 
tion performed by means of said user interface 
for said audio data, and 35 

the first control means in said device makes 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to provide 40 
the function represented by said audio data 
corresponding to said control code. 

66. (added) The network control system according 

to claim 24, wherein said function information 45 
includes one or a plurality pieces of user interface 
information for each of the control codes in said 
device. 

67. (added) The equipment according to claim 25. so 
wherein 

sard user interface information includes audio 
data, and 

the first control means in said device makes 55 
said device operate in accordance with the 
control code received from said controller with 
said device corrununication means to provide 



the function represented by said audio data 
corresponding to said control code. 

68. (added) The equipment according to claim 25. 
wherein said function information includes one or a 
plurality pieces of user interface information for 
each of the control codes in said device. 

69. (added) The equipment according to daim 26. 
wherein 

said user interface information indudes audio 
data. 

said controller has audio reproducing means 
for said user interface, and 
the second control means in said controller 
controls said device by reproducing audio indi- 
cating the functions of said device with said 
audio reproducing means through the use of 
the audio data included in said function infor- 
mation acquired from said device with said 
controller communication means to present 
said functions to the user, and transmitting the 
control code corresponding to said audio data 
with said controller communication means 
according to the user's operation performed by 
means of said user interface for said audio 
data. 

70. (amended) The equipment according to daim 
26, wherein said function information indudes one 
or a plurality pieces of user interface information for 
each of the control codes in said device. 
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